-- Logs begin at Thu 2022-07-14 10:37:38 UTC, end at Thu 2022-07-14 11:41:55 UTC. -- Jul 14 11:02:33.524870 dv-cinder-848938-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 11:02:33.535236 dv-cinder-848938-2-smb devstack@keystone.service[80320]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 11:02:33 2022] *** Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: nodename: dv-cinder-848938-2-smb Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: machine: x86_64 Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: clock source: unix Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: pcre jit disabled Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: detected number of CPU cores: 4 Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: current working directory: / Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: detected binary path: /usr/bin/uwsgi-core Jul 14 11:02:33.537362 dv-cinder-848938-2-smb devstack@keystone.service[80320]: your processes number limit is 47680 Jul 14 11:02:33.537928 dv-cinder-848938-2-smb devstack@keystone.service[80320]: your memory page size is 4096 bytes Jul 14 11:02:33.537928 dv-cinder-848938-2-smb devstack@keystone.service[80320]: detected max file descriptor number: 2048 Jul 14 11:02:33.537928 dv-cinder-848938-2-smb devstack@keystone.service[80320]: lock engine: pthread robust mutexes Jul 14 11:02:33.537928 dv-cinder-848938-2-smb devstack@keystone.service[80320]: thunder lock: enabled Jul 14 11:02:33.537928 dv-cinder-848938-2-smb devstack@keystone.service[80320]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 11:02:33.537928 dv-cinder-848938-2-smb devstack@keystone.service[80320]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 11:02:33.581901 dv-cinder-848938-2-smb devstack@keystone.service[80320]: Python main interpreter initialized at 0x55e32bebc9c0 Jul 14 11:02:33.581901 dv-cinder-848938-2-smb devstack@keystone.service[80320]: python threads support enabled Jul 14 11:02:33.581901 dv-cinder-848938-2-smb devstack@keystone.service[80320]: your server socket listen backlog is limited to 100 connections Jul 14 11:02:33.581901 dv-cinder-848938-2-smb devstack@keystone.service[80320]: your mercy for graceful operations on workers is 90 seconds Jul 14 11:02:33.582270 dv-cinder-848938-2-smb devstack@keystone.service[80320]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 11:02:33.582346 dv-cinder-848938-2-smb devstack@keystone.service[80320]: *** Operational MODE: preforking *** Jul 14 11:02:33.582608 dv-cinder-848938-2-smb devstack@keystone.service[80320]: *** uWSGI is running in multiple interpreter mode *** Jul 14 11:02:33.582608 dv-cinder-848938-2-smb devstack@keystone.service[80320]: spawned uWSGI master process (pid: 80320) Jul 14 11:02:33.582828 dv-cinder-848938-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 14 11:02:33.584988 dv-cinder-848938-2-smb devstack@keystone.service[80320]: spawned uWSGI worker 1 (pid: 80333, cores: 1) Jul 14 11:02:33.584988 dv-cinder-848938-2-smb devstack@keystone.service[80320]: spawned uWSGI worker 2 (pid: 80334, cores: 1) Jul 14 11:02:33.584988 dv-cinder-848938-2-smb devstack@keystone.service[80320]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 11:02:39.146709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:02:39.146709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: from cryptography.utils import int_from_bytes Jul 14 11:02:39.147488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:02:39.147488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: from cryptography.utils import int_from_bytes Jul 14 11:02:39.197108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:02:39.197297 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:02:39.197531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] command line args: [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:02:39.197800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:02:39.197982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ================================================================================ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:02:39.198240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] admin_token = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.198488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] config_dir = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.198678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.198862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] config_source = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.199042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] debug = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.199242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.201202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.201400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.201741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.201912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.202218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.202377 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] log_config_append = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.202500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.202621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] log_dir = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.203448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] log_file = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.203619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.203882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.204195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.204372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.204673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.204673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.204958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.205285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.205648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.205997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.205997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.206623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.206623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.207176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.207176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.207777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.208088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] publish_errors = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.208426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.208664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.208664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.209124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.209124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.209619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] standard_threads = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.209854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.210042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:02:39.210042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: from cryptography.utils import int_from_bytes Jul 14 11:02:39.211026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.211256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 11:02:39.211256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: from cryptography.utils import int_from_bytes Jul 14 11:02:39.211735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.211735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] use_journal = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.211735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] use_json = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.211735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] use_stderr = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.211735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] use_syslog = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.211735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.211735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.211735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.213267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.213267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.213267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.213267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.213267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.214152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.214152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.214152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.214152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.214655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.214655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.214919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.215048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.215291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.215529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.215788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.216045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.216320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.216561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.216822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.217087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.217343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.217594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.217828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.218061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.218295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.218530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.219381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.219637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.219872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.220151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.220383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.220632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.220872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.221122 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.221354 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.221593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.221830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.222062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.222294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.222527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.222759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.222997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.223246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.223479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.223717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.223949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.224209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.224449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.224698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.224930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.225169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.225406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.225644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.225880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.226117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.226348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.226598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.226841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.227077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.227312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.227571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.227806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.228039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.228300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.228540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.228811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.229050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.229299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.229547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.229786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.230023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.230261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.230670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.230916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.231158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.231459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.231707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.231948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.232199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.232442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.232676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.232941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.233184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.233426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.233668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.233912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.234150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.234412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.234649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.234884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.235118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.235352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.235589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.235824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.236067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.236327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.236579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.236823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.237080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.237367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.237616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.237847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.external = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.238080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.238376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.238609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.238842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.password = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.239074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.token = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.239313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.239549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.239794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.240026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.240332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.240582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.240815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.241051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.241298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.241549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.241798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.242036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.242280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.242516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.242781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.243034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.243273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.243526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.243813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.244063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.244352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.244600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.244858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.245094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.245335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.245582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.245830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.246064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.246312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.246552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.246821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.247061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.247317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.247555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.247809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.248037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.248317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.248567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.248806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.249044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.249294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.249526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.249764 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.250039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.250291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.250524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.250756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.250986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.251232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.251479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.251725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.252245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.253124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.253356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.253610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.253860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.254104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.254350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.254588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.254829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.255076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.255323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.255575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.255800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.256049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.256341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.256585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.256826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.257076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.257311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.257546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.257779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.258019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.258277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.258424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 11:02:39.258587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.258741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 11:02:39.259018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.259171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] command line args: [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 11:02:39.259327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.259467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 11:02:39.259596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.259773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ================================================================================ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 11:02:39.259916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.260046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] admin_token = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.260215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.260357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_dir = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.260357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.260602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.260730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] config_source = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.260859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.261001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] debug = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.261178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.261309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.261467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.261598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.261738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.261869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.261999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.262128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.262258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.262392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.262533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.262664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.262664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_config_append = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.262924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.263055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.263184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.263325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_dir = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.263325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.263569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.263734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.263900 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.264041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.264228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.264368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.264504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.264645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.264778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.264915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.265046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.265175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.265307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.265307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.266071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.266202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.266337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.266477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.266607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.266735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.266883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.267012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.267149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.267279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.267409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.267538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.267673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.267802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.267939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.268068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.268223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.268367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.268367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.268627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.268787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.268929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] publish_errors = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.269060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.269189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.269326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.269457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.269457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.269707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.269837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.269966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.270125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.270264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.270401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] standard_threads = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.270543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.270674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.270809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.270939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.271068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.271205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.271336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.271471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_journal = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.271471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_json = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.271717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.271847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_stderr = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.271984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.272146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] use_syslog = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.272299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.272431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 11:02:39.272561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.272692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.272836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.272968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.273098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.273229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.273358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.273488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.273625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.273768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.273920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.274139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.274316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.274451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.274590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.274722 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.274852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.274982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.275120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.275257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.275396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.275527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.275657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.275788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.275918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] role.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.276048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.276223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] role.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.276357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.276494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.276630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.276768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.276768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.277022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.277155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.277285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.277416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.277554 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.277686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.277823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.277970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.278100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.278100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.278346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.278346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.278598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.278729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.278865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.278997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.279126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.279256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.279394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.279527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.279667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.279798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.279927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.279927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.280239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.280382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.280512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.280642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.280772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.280913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.281045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.281804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.281943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.282091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.282229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.282410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.282550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.282686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.282823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.282958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.283093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.283242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.283381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.283517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.283653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.283796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.283936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.284092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.284256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.284393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.284530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.284667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.284802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.284953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.284953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.285211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.285348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.285484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.285664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.285812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.285960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.286096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.286231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.286368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] token.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.286502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.286647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.286784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.286920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.287055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.287191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.287327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.287471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.287607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.287742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.287888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.288024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.288205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.288359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.288498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.288634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.288769 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.288905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.289041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.289252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.289392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.289529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.289665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.289812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.289947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.290091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.290228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.290364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.290501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.290645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.290782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.290926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.291063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.291199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.291335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.291335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.291591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.291753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.291903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.292040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.292199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.292338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.292475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.292612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.292759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.292897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.293039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.293176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.293312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.293447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.293591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.293740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.293887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.294024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.294161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.294296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.294439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.294583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.294721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.294857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.294993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.295128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.295271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.295408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.295554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.295691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.295829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.295964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296699 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.296996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.298124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.external = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.password = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] auth.token = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.299252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.300393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.301535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.302659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.303799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.303799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.303799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.303799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.303799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.304501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.304501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.304501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.304879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.304879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.305135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.305341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.305478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.305657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.305909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.306156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.306388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.306626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.306856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.307099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.307343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.307587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.307838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.308082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.308385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.308629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.308865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.309096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.309330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.309559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.309798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.310017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.310253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.310505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.310735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.310979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.311223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.311456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.311701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.311949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.312207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.312470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.312701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.312935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.313167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.313408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.313642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.313876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.314123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.314368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.314599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.314828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.315074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.315319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.315817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.316052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.316317 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.316539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.316777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.317034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.317264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.317507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.317752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.317994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.318227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.318455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.318687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.318920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.319154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.319383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.319627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.319870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.320144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.320376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.320538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.320695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.320843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.321069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.321242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.321387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.321387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.321646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.321790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.321954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.322198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.322443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.322678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.322930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.323159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.323402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.323636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.323870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.324122 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.324383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.324633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.324865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.325108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.325350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.325598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.325845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.326080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.326328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.326577 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.326843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.327088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.327324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.327560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.327794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.328582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.328813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.329060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.329304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.329548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.329793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.329938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.330078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.330271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.330516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.330761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.330991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.331235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.331479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.331722 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.331965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.332446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.332686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.332937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.333187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.333435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.333683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.333916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.334169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.334421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.334660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.334894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.335126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.335358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.335609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.335863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.336126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.336367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.336603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.336833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.337075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.337312 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.337557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.337792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.338045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.338289 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.338525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.338766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.339007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.339250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.339484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.339720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.339952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.340227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.340476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.340705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.340945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.341240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.341500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.341744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.341987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.342222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.342465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.342699 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.342934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.343167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.343401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.344279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.344521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.344766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.345007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.345256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.345490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.345733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.345963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.346202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.346473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 11:02:39.346628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80333) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 11:02:39.358624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.359000 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.372712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.372955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.373248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.382330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.401370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.401565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.501841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.529198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.553274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.553551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.566400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.566713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.619970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.620176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.620254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.620320 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.620423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.620637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.620760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.620834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.620895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.621071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.621207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.621462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.647684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.647867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.647962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.648169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.648305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.648375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.648529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.648615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.648819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.648906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.649027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.649215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.649506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.649796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.660532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.663304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.675334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.675620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.675802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.676017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.676265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.676686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.676686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80333) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.678837 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.679070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.679296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.679518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.679736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.679950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.680196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 11:02:39.695496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.695721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:02:39.695999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.696191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.696356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:02:39.696499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:02:39.696499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.696775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.696911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.697049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 11:02:39.697195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.697336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.697473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.697473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.697780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.698043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.709626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.709903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.710170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.710451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.711406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.711883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.712385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.712604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.720935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.724281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.724567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.724854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.725139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.725286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.725531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.726108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.726459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.726746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.727021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.727301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.727573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.728958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.729242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.729528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.729811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.730095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.730357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.730626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.730897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.731164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.731433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.731698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.755033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.756846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.757129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.759262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.760943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.761222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.762484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.762767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.763051 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.767136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.767412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.767693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.771320 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.771607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.775685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.775869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.776186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.776588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.776876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.777170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.777441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.777723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.777995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.778265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.780310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.780600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.780881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.781188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.781464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.781738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.782007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.782275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.797630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.797908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.801659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.801944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.802674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.806407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.806652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.806799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.810318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.810610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.811788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.816271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.816618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.820077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.820282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.820483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.820684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.820979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.821265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.821543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.823914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.824241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.824535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.824830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.825104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.825378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.840758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.841053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.841322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.841594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.844689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.844984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.845250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.845517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.849741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.851688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.851972 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.853519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.855128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.855322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.855476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.855647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.855796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.855955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.856236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.858856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.859106 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.859916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.860220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.860501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.874364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.874710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.875675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.875675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.875985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.876159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.876319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.877970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.878158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.878301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.878439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.878590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.878729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.878729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.896589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.897151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.900020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.900568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.903545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.904035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.905395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.905731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.907416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.907605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.907783 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.907923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.908061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.908259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.915600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.915846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.917233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.917401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.920569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.920775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.920928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.921084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.921221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.921355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.921505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.921643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.931436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.931754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.931914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.932084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.932295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.932500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.941048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.941339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80333) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 11:02:39.941512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.941658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.941799 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.941938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.942076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.942213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.942361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.942500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.942639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.942795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.942935 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.943082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.943221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.943373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.943373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.943697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.943840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.943980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.944150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.944311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.944462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.944602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.944741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.944881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.945019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80333) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.945158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 11:02:39.982678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e32bebc9c0 pid: 80334 (default app) Jul 14 11:02:39.982987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e32bebc9c0 pid: 80333 (default app) Jul 14 11:02:39.986908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f448-017a-46d5-b07b-313f354b2cb8 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:39.987198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f448-017a-46d5-b07b-313f354b2cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:39.987552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0f448-017a-46d5-b07b-313f354b2cb8 None None] PATH_INFO: `/v3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:39.991924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Thu Jul 14 11:02:39 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:47.751230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f1a7-53c3-4bcb-a62f-b6017b502db7 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.751797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f1a7-53c3-4bcb-a62f-b6017b502db7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.751797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f1a7-53c3-4bcb-a62f-b6017b502db7 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.756254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:02:47.761432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:47.761866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:47.761990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:47.832378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: INFO dbcounter [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] Registered counter for database keystone Jul 14 11:02:47.854152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG oslo_db.sqlalchemy.engines [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:02:47.860518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writer thread running {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:02:48.035860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG passlib.handlers.bcrypt [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80334) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 11:02:48.036316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG passlib.handlers.bcrypt [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80334) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 11:02:48.094649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:48.096288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:48.221787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 11:02:48.418773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50f1a7-53c3-4bcb-a62f-b6017b502db7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:48.490317 dv-cinder-848938-2-smb devstack@keystone.service[80333]: INFO dbcounter [None req-8b50f1a7-53c3-4bcb-a62f-b6017b502db7 None None] Registered counter for database keystone Jul 14 11:02:48.509491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG oslo_db.sqlalchemy.engines [None req-8b50f1a7-53c3-4bcb-a62f-b6017b502db7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80333) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 11:02:48.515614 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writer thread running {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 11:02:48.633611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50f1a7-53c3-4bcb-a62f-b6017b502db7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:48.637908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57621a55-68eb-49f3-b443-059c064b1f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:48.638569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621a55-68eb-49f3-b443-059c064b1f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:48.638855 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621a55-68eb-49f3-b443-059c064b1f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:48.639133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57621a55-68eb-49f3-b443-059c064b1f22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:48.647303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57621a55-68eb-49f3-b443-059c064b1f22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:48.699410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING keystone.common.rbac_enforcer.enforcer [None req-57621a55-68eb-49f3-b443-059c064b1f22 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 11:02:48.699676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57621a55-68eb-49f3-b443-059c064b1f22 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:48.710117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Thu Jul 14 11:02:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:02:48.716157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:48.731157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3930a-b6d8-41e6-852f-379d15faecec None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:48.736261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b3f62-393e-41c9-bae7-0727ae39279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:48.737389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b3f62-393e-41c9-bae7-0727ae39279a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:48.737677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b3f62-393e-41c9-bae7-0727ae39279a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:48.737952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b3f62-393e-41c9-bae7-0727ae39279a admin admin] PATH_INFO: `/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:48.739452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b3f62-393e-41c9-bae7-0727ae39279a admin admin] RBAC: Authorizing `identity:get_project(project_id=5bd9aa1d8c77470b8cfa8dc04c19be52)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:48.792330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c30b3f62-393e-41c9-bae7-0727ae39279a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 11:02:48.792909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b3f62-393e-41c9-bae7-0727ae39279a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:48.797337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Thu Jul 14 11:02:48 2022] GET /identity/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:50.839603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93899ba8-d667-4687-868f-f0ba7853a590 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:50.840144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93899ba8-d667-4687-868f-f0ba7853a590 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:50.840245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93899ba8-d667-4687-868f-f0ba7853a590 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:50.844862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:02:50.850241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ffe3-3521-44c1-82b6-1272a6c88909 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:50.850662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ffe3-3521-44c1-82b6-1272a6c88909 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:50.850794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877ffe3-3521-44c1-82b6-1272a6c88909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:50.870409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d877ffe3-3521-44c1-82b6-1272a6c88909 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:50.871920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d877ffe3-3521-44c1-82b6-1272a6c88909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:50.879717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 11:02:50.902267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93899ba8-d667-4687-868f-f0ba7853a590 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:50.914951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93899ba8-d667-4687-868f-f0ba7853a590 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:50.919177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1b0f-34ab-4757-89d8-6dd8d1da255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:50.919816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1b0f-34ab-4757-89d8-6dd8d1da255e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:50.920124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1b0f-34ab-4757-89d8-6dd8d1da255e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:50.920410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1b0f-34ab-4757-89d8-6dd8d1da255e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:50.928759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec1b0f-34ab-4757-89d8-6dd8d1da255e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:50.930544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec1b0f-34ab-4757-89d8-6dd8d1da255e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:50.939432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Thu Jul 14 11:02:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:02:50.945347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ffe3-3521-44c1-82b6-1272a6c88909 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:50.954421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877ffe3-3521-44c1-82b6-1272a6c88909 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:50.958707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4abf-73b0-4f6f-b4de-bcedbab266bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:50.959639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4abf-73b0-4f6f-b4de-bcedbab266bf admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:50.959926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4abf-73b0-4f6f-b4de-bcedbab266bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:50.960239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4abf-73b0-4f6f-b4de-bcedbab266bf admin admin] PATH_INFO: `/v3/users/7c31e5107fca4386ab7dffdeb4815b90` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:50.961636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4abf-73b0-4f6f-b4de-bcedbab266bf admin admin] RBAC: Authorizing `identity:get_user(user_id=7c31e5107fca4386ab7dffdeb4815b90)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:50.963472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4abf-73b0-4f6f-b4de-bcedbab266bf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:50.965088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Thu Jul 14 11:02:50 2022] GET /identity/v3/users/7c31e5107fca4386ab7dffdeb4815b90 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:53.084036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446386f-204b-405c-8a24-0f4eeb218a12 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.084591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446386f-204b-405c-8a24-0f4eeb218a12 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.084591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446386f-204b-405c-8a24-0f4eeb218a12 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.085962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:02:53.091098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d087c8-7379-47da-a738-de52dfe3869e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.091547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d087c8-7379-47da-a738-de52dfe3869e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.091731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d087c8-7379-47da-a738-de52dfe3869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.111158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d1d087c8-7379-47da-a738-de52dfe3869e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:53.112362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d1d087c8-7379-47da-a738-de52dfe3869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:53.128907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042944-d4a4-496c-b9f9-701a2e126c92 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.129200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042944-d4a4-496c-b9f9-701a2e126c92 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.129489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042944-d4a4-496c-b9f9-701a2e126c92 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.130839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:02:53.136281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.136575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.136857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.176379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG passlib.handlers.bcrypt [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80333) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 11:02:53.176812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG passlib.handlers.bcrypt [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80333) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 11:02:53.193365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:02:53.217182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d087c8-7379-47da-a738-de52dfe3869e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.223378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:53.225044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:53.241283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:53.323622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d087c8-7379-47da-a738-de52dfe3869e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:53.330420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:02:53.355839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.365232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e64f62-c495-4c41-9616-2f6410ee52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:53.366060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64f62-c495-4c41-9616-2f6410ee52a4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.366352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64f62-c495-4c41-9616-2f6410ee52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.366631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64f62-c495-4c41-9616-2f6410ee52a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.380174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e64f62-c495-4c41-9616-2f6410ee52a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-b6e64f62-c495-4c41-9616-2f6410ee52a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:02:53.391899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:02:53.392933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:02:53.393741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:02:53.399501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e64f62-c495-4c41-9616-2f6410ee52a4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.468394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96538b70-461f-4a6d-86d5-3277a602790f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:53.470730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:53.485988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:53.506001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e64f62-c495-4c41-9616-2f6410ee52a4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:53.508712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565527-a695-4d6c-aa1a-75f48c1c340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:53.509627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565527-a695-4d6c-aa1a-75f48c1c340f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.509915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565527-a695-4d6c-aa1a-75f48c1c340f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.510197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da565527-a695-4d6c-aa1a-75f48c1c340f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.544582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:53.545258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.545550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.545830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.547144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:53.547539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:53.548913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:53.561028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:02:53.567518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.586427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565527-a695-4d6c-aa1a-75f48c1c340f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:53.588009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da565527-a695-4d6c-aa1a-75f48c1c340f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:53.669054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605b06f-4ea9-425e-909a-0342a4d201c5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:53.692316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:02:53.697904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565527-a695-4d6c-aa1a-75f48c1c340f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.700857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:53.704516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0725141-8efd-4f69-b4f0-4817aaf26f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:53.705414 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725141-8efd-4f69-b4f0-4817aaf26f81 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.705700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725141-8efd-4f69-b4f0-4817aaf26f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.705980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725141-8efd-4f69-b4f0-4817aaf26f81 None admin] PATH_INFO: `/v3/users/7c31e5107fca4386ab7dffdeb4815b90` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.707224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725141-8efd-4f69-b4f0-4817aaf26f81 None admin] RBAC: Authorizing `identity:get_user(user_id=7c31e5107fca4386ab7dffdeb4815b90)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:53.708753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725141-8efd-4f69-b4f0-4817aaf26f81 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:53.710576 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/users/7c31e5107fca4386ab7dffdeb4815b90 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:02:53.716011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0725141-8efd-4f69-b4f0-4817aaf26f81 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.732345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:53.799533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da565527-a695-4d6c-aa1a-75f48c1c340f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:53.820641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0725141-8efd-4f69-b4f0-4817aaf26f81 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:53.837059 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:53.837874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.838154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.838427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.855315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab64c-773f-4f05-8f59-8ee7e81b4005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:53.856152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab64c-773f-4f05-8f59-8ee7e81b4005 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:53.856433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab64c-773f-4f05-8f59-8ee7e81b4005 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:53.856705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fab64c-773f-4f05-8f59-8ee7e81b4005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:53.857905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fab64c-773f-4f05-8f59-8ee7e81b4005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:53.859986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fab64c-773f-4f05-8f59-8ee7e81b4005 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:53.861251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:53.861909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:02:53.862893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:53.867693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab64c-773f-4f05-8f59-8ee7e81b4005 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:02:53.884811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:02:53.885737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:02:53.886550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:02:53.886550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:02:53.886550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:02:53.886550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:02:53.886550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:02:53.893291 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:53.955026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:53.956812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:53.975924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fab64c-773f-4f05-8f59-8ee7e81b4005 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:54.002554 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cd129-23e2-44d3-b4d9-e52ba6d0dbce None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:54.011317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941e185-36ae-44f7-bc45-da8ef4c94f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:54.011986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941e185-36ae-44f7-bc45-da8ef4c94f53 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:54.012309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941e185-36ae-44f7-bc45-da8ef4c94f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:54.012589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941e185-36ae-44f7-bc45-da8ef4c94f53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:54.013497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941e185-36ae-44f7-bc45-da8ef4c94f53 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.domain.id=default, user.id=7c31e5107fca4386ab7dffdeb4815b90) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:54.013757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941e185-36ae-44f7-bc45-da8ef4c94f53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:54.015809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941e185-36ae-44f7-bc45-da8ef4c94f53 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:54.023274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1322 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/role_assignments?user.id=7c31e5107fca4386ab7dffdeb4815b90&scope.domain.id=default&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:02:54.038593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51487067-a73f-401e-ae32-cac36ee2a71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:54.039295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51487067-a73f-401e-ae32-cac36ee2a71a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:54.039619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51487067-a73f-401e-ae32-cac36ee2a71a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:54.039903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51487067-a73f-401e-ae32-cac36ee2a71a None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:54.040724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51487067-a73f-401e-ae32-cac36ee2a71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:54.041039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51487067-a73f-401e-ae32-cac36ee2a71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:54.042514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51487067-a73f-401e-ae32-cac36ee2a71a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:54.062944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:02:56.404959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f329a-f858-425c-9579-4bb7e3a6a4bd None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:56.405759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f329a-f858-425c-9579-4bb7e3a6a4bd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:56.405759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f329a-f858-425c-9579-4bb7e3a6a4bd None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:56.407272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:02:56.413121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf608c3-7def-4042-b41f-20562698e3ad None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:56.413594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf608c3-7def-4042-b41f-20562698e3ad None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:56.413676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf608c3-7def-4042-b41f-20562698e3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:56.441444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8bf608c3-7def-4042-b41f-20562698e3ad None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:56.442670 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8bf608c3-7def-4042-b41f-20562698e3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:56.547415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:02:56.583171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f329a-f858-425c-9579-4bb7e3a6a4bd None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:56.606374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76adb44-6e65-41a8-b92f-cb77ff7d91bd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:56.606936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76adb44-6e65-41a8-b92f-cb77ff7d91bd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:56.612809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76adb44-6e65-41a8-b92f-cb77ff7d91bd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:56.614763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:02:56.620922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c4614-5aca-4c5e-985e-3e04dfbd54f0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:56.621420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c4614-5aca-4c5e-985e-3e04dfbd54f0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:56.621842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c4614-5aca-4c5e-985e-3e04dfbd54f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:56.658875 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4d0c4614-5aca-4c5e-985e-3e04dfbd54f0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:56.660526 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4d0c4614-5aca-4c5e-985e-3e04dfbd54f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:56.774850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:56.799722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f329a-f858-425c-9579-4bb7e3a6a4bd None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:56.841555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:02:56.857653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bb822-b9eb-4b58-b494-62a1dca93577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:56.858464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bb822-b9eb-4b58-b494-62a1dca93577 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:56.858776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bb822-b9eb-4b58-b494-62a1dca93577 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:56.859583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bb822-b9eb-4b58-b494-62a1dca93577 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:56.877151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c4614-5aca-4c5e-985e-3e04dfbd54f0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:56.882031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bb822-b9eb-4b58-b494-62a1dca93577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-878bb822-b9eb-4b58-b494-62a1dca93577 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:02:56.893998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:02:56.895413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:02:56.896390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 13/26] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:02:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:02:56.904519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bb822-b9eb-4b58-b494-62a1dca93577 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:56.912724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:57.072757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bb822-b9eb-4b58-b494-62a1dca93577 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:57.098099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c4614-5aca-4c5e-985e-3e04dfbd54f0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:57.132010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59554e-a95f-46be-80d4-a594bbf695e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:57.132722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59554e-a95f-46be-80d4-a594bbf695e5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.133012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59554e-a95f-46be-80d4-a594bbf695e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.133289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59554e-a95f-46be-80d4-a594bbf695e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.134061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59554e-a95f-46be-80d4-a594bbf695e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:57.134368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59554e-a95f-46be-80d4-a594bbf695e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:57.135784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59554e-a95f-46be-80d4-a594bbf695e5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:57.154254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 14/27] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:02:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:57.157222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27bec-ca54-4644-86a6-da46c789e253 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.158111 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27bec-ca54-4644-86a6-da46c789e253 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.159071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf27bec-ca54-4644-86a6-da46c789e253 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.162497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 15/28] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:02:57.163940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf27bec-ca54-4644-86a6-da46c789e253 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:57.166378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2f40e-d54e-41b9-aad2-2afebb3085ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:57.167384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2f40e-d54e-41b9-aad2-2afebb3085ab None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.167816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2f40e-d54e-41b9-aad2-2afebb3085ab None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.168281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2f40e-d54e-41b9-aad2-2afebb3085ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.193121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2f40e-d54e-41b9-aad2-2afebb3085ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:57.194871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2f40e-d54e-41b9-aad2-2afebb3085ab None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-dca2f40e-d54e-41b9-aad2-2afebb3085ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:02:57.216716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:02:57.217620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:02:57.219027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:02:57.219027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:02:57.219027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:02:57.219027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:02:57.228614 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 14/29] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:02:57.230454 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f544f-cb7e-4658-ba6f-d2684b275f02 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.230932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f544f-cb7e-4658-ba6f-d2684b275f02 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.231398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f544f-cb7e-4658-ba6f-d2684b275f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.252442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:57.262344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a95f544f-cb7e-4658-ba6f-d2684b275f02 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:57.264571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a95f544f-cb7e-4658-ba6f-d2684b275f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:57.301879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:57.337891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf27bec-ca54-4644-86a6-da46c789e253 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:57.374998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 15/30] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:02:57.377023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f544f-cb7e-4658-ba6f-d2684b275f02 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:57.380616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b4400-111c-4788-af10-bf5b44d470ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:57.382420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b4400-111c-4788-af10-bf5b44d470ec None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.382420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b4400-111c-4788-af10-bf5b44d470ec None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.382420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b4400-111c-4788-af10-bf5b44d470ec None admin] PATH_INFO: `/v3/users/7c31e5107fca4386ab7dffdeb4815b90` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.383639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b4400-111c-4788-af10-bf5b44d470ec None admin] RBAC: Authorizing `identity:get_user(user_id=7c31e5107fca4386ab7dffdeb4815b90)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:57.385246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b4400-111c-4788-af10-bf5b44d470ec None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:57.387007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 16/31] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:02:57 2022] GET /identity/v3/users/7c31e5107fca4386ab7dffdeb4815b90 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:57.392433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ffced-5d67-44aa-b3fb-02550f6d5a85 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.393012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ffced-5d67-44aa-b3fb-02550f6d5a85 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.393234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ffced-5d67-44aa-b3fb-02550f6d5a85 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.394706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 17/32] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:02:57.399627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ffced-5d67-44aa-b3fb-02550f6d5a85 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:57.508885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ffced-5d67-44aa-b3fb-02550f6d5a85 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:57.515088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f544f-cb7e-4658-ba6f-d2684b275f02 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:57.550232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b75d2-3c7a-48a6-9e41-0794ca2296f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:57.551320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b75d2-3c7a-48a6-9e41-0794ca2296f2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.551784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b75d2-3c7a-48a6-9e41-0794ca2296f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.552351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b75d2-3c7a-48a6-9e41-0794ca2296f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.553859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b75d2-3c7a-48a6-9e41-0794ca2296f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:57.555700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b75d2-3c7a-48a6-9e41-0794ca2296f2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:57.563210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 18/33] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:02:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:57.565092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3471f8-9350-4d24-bd46-a8bf689456d4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.565577 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:57.565968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3471f8-9350-4d24-bd46-a8bf689456d4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.566510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.566611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3471f8-9350-4d24-bd46-a8bf689456d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.566798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.567080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.567828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:02:57.568182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:57.569821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:57.573653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:57.586836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 16/34] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:57.588620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:57.592842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1e3471f8-9350-4d24-bd46-a8bf689456d4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:57.594376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1e3471f8-9350-4d24-bd46-a8bf689456d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:57.616460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:57.680427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 19/35] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:02:57.681989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3471f8-9350-4d24-bd46-a8bf689456d4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:57.714728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4dc8c-3cb9-4e4f-8c7d-1e5476590bd7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:57.751436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54266bff-fae4-4f56-a1ed-df9dce6eb8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:57.752575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54266bff-fae4-4f56-a1ed-df9dce6eb8da None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.753061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54266bff-fae4-4f56-a1ed-df9dce6eb8da None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.753565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54266bff-fae4-4f56-a1ed-df9dce6eb8da None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.754599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54266bff-fae4-4f56-a1ed-df9dce6eb8da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:57.756220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54266bff-fae4-4f56-a1ed-df9dce6eb8da None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:57.804019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3471f8-9350-4d24-bd46-a8bf689456d4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:57.837511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:57.844526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d22440-c962-4cdf-9926-f59db6504105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:57.845418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22440-c962-4cdf-9926-f59db6504105 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:57.845713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22440-c962-4cdf-9926-f59db6504105 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:57.845993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d22440-c962-4cdf-9926-f59db6504105 None admin] PATH_INFO: `/v3/domains/default/users/7c31e5107fca4386ab7dffdeb4815b90/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:57.848049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d22440-c962-4cdf-9926-f59db6504105 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7c31e5107fca4386ab7dffdeb4815b90, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:57.849564 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d22440-c962-4cdf-9926-f59db6504105 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:57.921752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 17/36] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Jul 14 11:02:57 2022] POST /identity/v3/roles => generated 219 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:57.924432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54266bff-fae4-4f56-a1ed-df9dce6eb8da None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:58.008418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 20/37] 10.222.0.17 () {58 vars in 1361 bytes} [Thu Jul 14 11:02:57 2022] PUT /identity/v3/domains/default/users/7c31e5107fca4386ab7dffdeb4815b90/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:02:58.010162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d22440-c962-4cdf-9926-f59db6504105 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:58.022499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:58.060073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54266bff-fae4-4f56-a1ed-df9dce6eb8da None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:58.117093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ed82-2e72-4f8d-b156-ebcb04321402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:58.117804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ed82-2e72-4f8d-b156-ebcb04321402 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.118093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ed82-2e72-4f8d-b156-ebcb04321402 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.118375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ed82-2e72-4f8d-b156-ebcb04321402 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.119521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3ed82-2e72-4f8d-b156-ebcb04321402 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:58.121366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3ed82-2e72-4f8d-b156-ebcb04321402 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:58.158943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 18/38] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:02:57 2022] POST /identity/v3/projects => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:58.163519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bd64e-72aa-4d86-bc1c-9384ae5aada6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.164282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bd64e-72aa-4d86-bc1c-9384ae5aada6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.164575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bd64e-72aa-4d86-bc1c-9384ae5aada6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.167478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 19/39] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:02:58.174316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f33dea-8b5f-447e-8e37-6f7dd482bb5d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.174631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f33dea-8b5f-447e-8e37-6f7dd482bb5d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.174892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f33dea-8b5f-447e-8e37-6f7dd482bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.207448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-68f33dea-8b5f-447e-8e37-6f7dd482bb5d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:58.209116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-68f33dea-8b5f-447e-8e37-6f7dd482bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:58.243007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d22440-c962-4cdf-9926-f59db6504105 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:58.304287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 20/40] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:02:58.324040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f33dea-8b5f-447e-8e37-6f7dd482bb5d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:58.402356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c744525-da2f-41a0-a959-9a537beed659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:58.403047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744525-da2f-41a0-a959-9a537beed659 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.403334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744525-da2f-41a0-a959-9a537beed659 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.403612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c744525-da2f-41a0-a959-9a537beed659 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.404427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c744525-da2f-41a0-a959-9a537beed659 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:58.406814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c744525-da2f-41a0-a959-9a537beed659 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:58.410924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:58.428702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Jul 14 11:02:58 2022] POST /identity/v3/roles => generated 225 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:02:58.430226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be39-94b5-4170-b43c-6f1ffb86188c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.430534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be39-94b5-4170-b43c-6f1ffb86188c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.430799 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be39-94b5-4170-b43c-6f1ffb86188c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.432165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 22/42] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:02:58.437970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f44d-37d4-4c81-9d76-735a5709e6b1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.438263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f44d-37d4-4c81-9d76-735a5709e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.438536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328f44d-37d4-4c81-9d76-735a5709e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.459127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7328f44d-37d4-4c81-9d76-735a5709e6b1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:02:58.461275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7328f44d-37d4-4c81-9d76-735a5709e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:02:58.471644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f33dea-8b5f-447e-8e37-6f7dd482bb5d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:58.523864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18ccaf-31a8-4ee1-8b5e-28cd75e097e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:58.525914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:58.538814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18ccaf-31a8-4ee1-8b5e-28cd75e097e6 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.539352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18ccaf-31a8-4ee1-8b5e-28cd75e097e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.539838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18ccaf-31a8-4ee1-8b5e-28cd75e097e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.541263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18ccaf-31a8-4ee1-8b5e-28cd75e097e6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:58.543588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18ccaf-31a8-4ee1-8b5e-28cd75e097e6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:58.554228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:02:58.563310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 21/44] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Jul 14 11:02:58 2022] POST /identity/v3/roles => generated 223 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:02:58.581492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328f44d-37d4-4c81-9d76-735a5709e6b1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:58.704545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328f44d-37d4-4c81-9d76-735a5709e6b1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:58.749194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd6476-b0b3-4864-af3a-2c89dcb41394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:58.750359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd6476-b0b3-4864-af3a-2c89dcb41394 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.750645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd6476-b0b3-4864-af3a-2c89dcb41394 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.750921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd6476-b0b3-4864-af3a-2c89dcb41394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.752175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd6476-b0b3-4864-af3a-2c89dcb41394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:58.753688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd6476-b0b3-4864-af3a-2c89dcb41394 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:58.755356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 24/45] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:02:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:02:58.761182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18ccaf-31a8-4ee1-8b5e-28cd75e097e6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:02:58.865565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18ccaf-31a8-4ee1-8b5e-28cd75e097e6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:02:58.886015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:02:58.901555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aa4b0-6738-448d-ac8c-ed8f0d15becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:02:58.902223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aa4b0-6738-448d-ac8c-ed8f0d15becf None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:02:58.902512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aa4b0-6738-448d-ac8c-ed8f0d15becf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:02:58.902792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aa4b0-6738-448d-ac8c-ed8f0d15becf None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:02:58.903506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aa4b0-6738-448d-ac8c-ed8f0d15becf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:02:58.905002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518aa4b0-6738-448d-ac8c-ed8f0d15becf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:02:58.931728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 22/46] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:02:58 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:03:00.287166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdb34-8d6e-47ba-aed7-c89fe5f1042a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:00.287682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdb34-8d6e-47ba-aed7-c89fe5f1042a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:00.287763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcdb34-8d6e-47ba-aed7-c89fe5f1042a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:00.289282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 25/47] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:00.294702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1395c6-73d0-4ee2-b98d-463ebeefc1e6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:00.295155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1395c6-73d0-4ee2-b98d-463ebeefc1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:00.295271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1395c6-73d0-4ee2-b98d-463ebeefc1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:00.313856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8d1395c6-73d0-4ee2-b98d-463ebeefc1e6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:00.315195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8d1395c6-73d0-4ee2-b98d-463ebeefc1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:00.381671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 23/48] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:00.405105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcdb34-8d6e-47ba-aed7-c89fe5f1042a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:00.457915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:00.511522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcdb34-8d6e-47ba-aed7-c89fe5f1042a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:00.548404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec286e5-a9be-4952-962c-dc5179257f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:00.549123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec286e5-a9be-4952-962c-dc5179257f5f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:00.549406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec286e5-a9be-4952-962c-dc5179257f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:00.549682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec286e5-a9be-4952-962c-dc5179257f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:00.559952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec286e5-a9be-4952-962c-dc5179257f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3ec286e5-a9be-4952-962c-dc5179257f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:00.568123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:00.569231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:00.570285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 26/49] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:00.575202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1395c6-73d0-4ee2-b98d-463ebeefc1e6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:00.675831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1395c6-73d0-4ee2-b98d-463ebeefc1e6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:00.677457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:00.712756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:00.713426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:00.713715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:00.714000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:00.714753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:00.715063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:00.716490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:00.728418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 24/50] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:00.734636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec286e5-a9be-4952-962c-dc5179257f5f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:00.835121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec286e5-a9be-4952-962c-dc5179257f5f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:00.847473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:00.871207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5e9b4-20a9-495f-8ff8-f4eff5bcafc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:00.872162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e9b4-20a9-495f-8ff8-f4eff5bcafc0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:00.872442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e9b4-20a9-495f-8ff8-f4eff5bcafc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:00.872767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e9b4-20a9-495f-8ff8-f4eff5bcafc0 None admin] PATH_INFO: `/v3/users/7c31e5107fca4386ab7dffdeb4815b90` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:00.873987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5e9b4-20a9-495f-8ff8-f4eff5bcafc0 None admin] RBAC: Authorizing `identity:get_user(user_id=7c31e5107fca4386ab7dffdeb4815b90)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:00.875507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5e9b4-20a9-495f-8ff8-f4eff5bcafc0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:00.877362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 27/51] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:00 2022] GET /identity/v3/users/7c31e5107fca4386ab7dffdeb4815b90 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:00.882815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:00.997446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6647-1244-4cce-bdde-7cce9ba40a46 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:00.998107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6647-1244-4cce-bdde-7cce9ba40a46 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:00.998396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb6647-1244-4cce-bdde-7cce9ba40a46 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:00.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 28/52] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:01.005009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422f6a-020f-4afd-9bd7-58763d83fafc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:01.005298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422f6a-020f-4afd-9bd7-58763d83fafc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:01.005574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0422f6a-020f-4afd-9bd7-58763d83fafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:01.022326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b0422f6a-020f-4afd-9bd7-58763d83fafc None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:01.023553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b0422f6a-020f-4afd-9bd7-58763d83fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:01.094287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 29/53] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:01.096386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa1f9d-d571-4352-b20b-dae6764be293 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:01.122328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0422f6a-020f-4afd-9bd7-58763d83fafc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:01.134025 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52934d21-9bd7-4444-8b16-1717736ec9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:01.134840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52934d21-9bd7-4444-8b16-1717736ec9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:01.135134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52934d21-9bd7-4444-8b16-1717736ec9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:01.135515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52934d21-9bd7-4444-8b16-1717736ec9a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:01.136649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52934d21-9bd7-4444-8b16-1717736ec9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:01.138142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52934d21-9bd7-4444-8b16-1717736ec9a3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:01.139794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 25/54] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:01.146145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52934d21-9bd7-4444-8b16-1717736ec9a3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:01.180530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:01.230729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0422f6a-020f-4afd-9bd7-58763d83fafc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:01.240083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:01.257412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52934d21-9bd7-4444-8b16-1717736ec9a3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:01.266303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1354b5-3d0a-429b-b23c-0a4b9d3b9950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:01.267111 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1354b5-3d0a-429b-b23c-0a4b9d3b9950 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:01.267396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1354b5-3d0a-429b-b23c-0a4b9d3b9950 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:01.267678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1354b5-3d0a-429b-b23c-0a4b9d3b9950 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:01.268919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1354b5-3d0a-429b-b23c-0a4b9d3b9950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:01.270405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1354b5-3d0a-429b-b23c-0a4b9d3b9950 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:01.272075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 30/55] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:01.277672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1354b5-3d0a-429b-b23c-0a4b9d3b9950 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:01.291378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc496c-f938-4d39-affd-daf4b31e119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:01.292046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc496c-f938-4d39-affd-daf4b31e119b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:01.292367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc496c-f938-4d39-affd-daf4b31e119b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:01.292647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc496c-f938-4d39-affd-daf4b31e119b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:01.293492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc496c-f938-4d39-affd-daf4b31e119b None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.domain.id=default, user.id=7c31e5107fca4386ab7dffdeb4815b90) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:01.293814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc496c-f938-4d39-affd-daf4b31e119b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:01.295266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc496c-f938-4d39-affd-daf4b31e119b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:01.305166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 26/56] 10.222.0.17 () {56 vars in 1322 bytes} [Thu Jul 14 11:03:01 2022] GET /identity/v3/role_assignments?user.id=7c31e5107fca4386ab7dffdeb4815b90&scope.domain.id=default&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:01.385589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1354b5-3d0a-429b-b23c-0a4b9d3b9950 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:01.422095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270bb3d-aff7-4b34-9049-602f162d671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:01.422775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270bb3d-aff7-4b34-9049-602f162d671b None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:01.423061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270bb3d-aff7-4b34-9049-602f162d671b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:01.423336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270bb3d-aff7-4b34-9049-602f162d671b None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:01.424063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270bb3d-aff7-4b34-9049-602f162d671b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:01.425595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270bb3d-aff7-4b34-9049-602f162d671b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:01.454803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 31/57] 10.222.0.17 () {60 vars in 1140 bytes} [Thu Jul 14 11:03:01 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:03:03.512954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7763e1-8365-4ade-9cef-90004c278d65 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:03.513510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7763e1-8365-4ade-9cef-90004c278d65 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:03.513510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7763e1-8365-4ade-9cef-90004c278d65 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:03.514954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 27/58] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:03.520372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6aef6-2556-4bcd-8f29-474f3a82bb38 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:03.520814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6aef6-2556-4bcd-8f29-474f3a82bb38 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:03.520944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6aef6-2556-4bcd-8f29-474f3a82bb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:03.538224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3ab6aef6-2556-4bcd-8f29-474f3a82bb38 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:03.539428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3ab6aef6-2556-4bcd-8f29-474f3a82bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:03.562538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:03.607097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 32/59] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:03.631243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7763e1-8365-4ade-9cef-90004c278d65 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:03.724944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:03.731818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7763e1-8365-4ade-9cef-90004c278d65 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:03.765716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a3ec1-a962-4a0d-8ca7-af2ab56ee3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:03.766340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a3ec1-a962-4a0d-8ca7-af2ab56ee3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:03.766623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a3ec1-a962-4a0d-8ca7-af2ab56ee3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:03.766899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a3ec1-a962-4a0d-8ca7-af2ab56ee3f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:03.768074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a3ec1-a962-4a0d-8ca7-af2ab56ee3f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:03.769562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a3ec1-a962-4a0d-8ca7-af2ab56ee3f8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:03.771176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 28/60] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:03.776938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6aef6-2556-4bcd-8f29-474f3a82bb38 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:03.876495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6aef6-2556-4bcd-8f29-474f3a82bb38 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:03.910480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622d00c-3199-4d75-bbc9-af4ab3e588f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:03.911158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622d00c-3199-4d75-bbc9-af4ab3e588f4 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:03.911449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622d00c-3199-4d75-bbc9-af4ab3e588f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:03.911736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622d00c-3199-4d75-bbc9-af4ab3e588f4 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:03.912493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622d00c-3199-4d75-bbc9-af4ab3e588f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:03.913980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622d00c-3199-4d75-bbc9-af4ab3e588f4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:03.939673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 33/61] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:03 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:03:07.140611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741300-2284-4a87-80b4-09228c9b45c9 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.141154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741300-2284-4a87-80b4-09228c9b45c9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.141154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741300-2284-4a87-80b4-09228c9b45c9 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.142866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 29/62] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:07.147940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b207-8613-43a2-9c67-cb5305df6c40 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.148377 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b207-8613-43a2-9c67-cb5305df6c40 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.148578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1b207-8613-43a2-9c67-cb5305df6c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.169349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bbb1b207-8613-43a2-9c67-cb5305df6c40 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:07.170563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bbb1b207-8613-43a2-9c67-cb5305df6c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:07.179208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07896b4-e4c9-4604-89c9-2c83a4443c62 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.179498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07896b4-e4c9-4604-89c9-2c83a4443c62 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.179778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07896b4-e4c9-4604-89c9-2c83a4443c62 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.181333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 30/63] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:07.186561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804781c6-0321-491d-8340-4686449baa3c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.187400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804781c6-0321-491d-8340-4686449baa3c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.187680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804781c6-0321-491d-8340-4686449baa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.187777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:07.225211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-804781c6-0321-491d-8340-4686449baa3c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:07.226544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-804781c6-0321-491d-8340-4686449baa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:07.272436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 34/64] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:07.296565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1b207-8613-43a2-9c67-cb5305df6c40 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:07.342711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 31/65] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:07.417295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804781c6-0321-491d-8340-4686449baa3c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:07.421853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1b207-8613-43a2-9c67-cb5305df6c40 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:07.460521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35191db1-f00f-497e-a364-3e28e4c426f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:07.461448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35191db1-f00f-497e-a364-3e28e4c426f7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.461749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35191db1-f00f-497e-a364-3e28e4c426f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.462034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35191db1-f00f-497e-a364-3e28e4c426f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.473807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35191db1-f00f-497e-a364-3e28e4c426f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-35191db1-f00f-497e-a364-3e28e4c426f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:07.482357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:07.483226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:07.484485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 35/66] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:07.489268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c505-9c79-4886-ae48-695ca5490334 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.489555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c505-9c79-4886-ae48-695ca5490334 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.490018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18c505-9c79-4886-ae48-695ca5490334 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.491708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 36/67] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:07.494321 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18c505-9c79-4886-ae48-695ca5490334 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:07.499662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:07.538625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:07.550594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804781c6-0321-491d-8340-4686449baa3c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:07.605362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549f8e1-4da5-448d-8fd7-c8f0ebd9550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:07.606819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f8e1-4da5-448d-8fd7-c8f0ebd9550c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.608235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f8e1-4da5-448d-8fd7-c8f0ebd9550c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.609334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549f8e1-4da5-448d-8fd7-c8f0ebd9550c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.625949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549f8e1-4da5-448d-8fd7-c8f0ebd9550c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7549f8e1-4da5-448d-8fd7-c8f0ebd9550c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:07.639121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:07.640161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:07.640971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:07.643157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 32/68] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:07.644271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b429f-a0eb-4c8c-9aa4-835c6a5b8fcb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.644560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b429f-a0eb-4c8c-9aa4-835c6a5b8fcb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.644842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b429f-a0eb-4c8c-9aa4-835c6a5b8fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.649225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18c505-9c79-4886-ae48-695ca5490334 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:07.662160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5a8b429f-a0eb-4c8c-9aa4-835c6a5b8fcb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:07.663311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a8b429f-a0eb-4c8c-9aa4-835c6a5b8fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:07.686555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:07.687979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.688548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.689008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.689958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:07.690431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:07.692501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:07.701992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 37/69] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:07.702886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:07.733434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 33/70] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:07.735609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159a7c-cfd5-43dc-afad-576ec504cf46 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.736128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159a7c-cfd5-43dc-afad-576ec504cf46 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.736578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159a7c-cfd5-43dc-afad-576ec504cf46 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.738009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 34/71] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:07.738870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159a7c-cfd5-43dc-afad-576ec504cf46 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:07.790510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:07.839523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d483f-93c8-4ca3-87db-0698e006951d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:07.846157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:07.872530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159a7c-cfd5-43dc-afad-576ec504cf46 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:07.878598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58291dd0-c59f-4604-bc6f-4b272d71dc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:07.879287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58291dd0-c59f-4604-bc6f-4b272d71dc19 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.879575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58291dd0-c59f-4604-bc6f-4b272d71dc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.879858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58291dd0-c59f-4604-bc6f-4b272d71dc19 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.880666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58291dd0-c59f-4604-bc6f-4b272d71dc19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:07.880978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58291dd0-c59f-4604-bc6f-4b272d71dc19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:07.882388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58291dd0-c59f-4604-bc6f-4b272d71dc19 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:07.892175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 38/72] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:07.893539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a1a2f-d0e3-40b8-b5a0-213c823a428c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.893838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a1a2f-d0e3-40b8-b5a0-213c823a428c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.894119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a1a2f-d0e3-40b8-b5a0-213c823a428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.912725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdbe56-d2d6-455a-9355-8966229ffc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:07.913716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdbe56-d2d6-455a-9355-8966229ffc98 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:07.914002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdbe56-d2d6-455a-9355-8966229ffc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:07.914281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdbe56-d2d6-455a-9355-8966229ffc98 None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:07.914498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-375a1a2f-d0e3-40b8-b5a0-213c823a428c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:07.916000 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-375a1a2f-d0e3-40b8-b5a0-213c823a428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:07.932579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdbe56-d2d6-455a-9355-8966229ffc98 None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:07.934068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdbe56-d2d6-455a-9355-8966229ffc98 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:07.936174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 35/73] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:07 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:07.937095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdbe56-d2d6-455a-9355-8966229ffc98 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.003094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 39/74] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:08.004784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2da3f-f5ee-46e1-ac6a-34f8f2f36dd0 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.005156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2da3f-f5ee-46e1-ac6a-34f8f2f36dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.005632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2da3f-f5ee-46e1-ac6a-34f8f2f36dd0 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.010667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 40/75] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:08.010667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2da3f-f5ee-46e1-ac6a-34f8f2f36dd0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.051814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdbe56-d2d6-455a-9355-8966229ffc98 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.087117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.090045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00320c19-7d1b-4aa5-9264-420c784eb955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.090929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00320c19-7d1b-4aa5-9264-420c784eb955 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.091215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00320c19-7d1b-4aa5-9264-420c784eb955 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.091500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00320c19-7d1b-4aa5-9264-420c784eb955 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.110054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00320c19-7d1b-4aa5-9264-420c784eb955 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-00320c19-7d1b-4aa5-9264-420c784eb955 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:08.118304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:08.119205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 36/76] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:08.125852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00320c19-7d1b-4aa5-9264-420c784eb955 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.127023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.146524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2da3f-f5ee-46e1-ac6a-34f8f2f36dd0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.195813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a50bc-d435-4973-814a-1d3c2ed2b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.196656 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a50bc-d435-4973-814a-1d3c2ed2b799 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.196949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a50bc-d435-4973-814a-1d3c2ed2b799 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.197229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a50bc-d435-4973-814a-1d3c2ed2b799 None admin] PATH_INFO: `/v3/users/7c31e5107fca4386ab7dffdeb4815b90` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.198427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a50bc-d435-4973-814a-1d3c2ed2b799 None admin] RBAC: Authorizing `identity:get_user(user_id=7c31e5107fca4386ab7dffdeb4815b90)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:08.199916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a50bc-d435-4973-814a-1d3c2ed2b799 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:08.201652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 41/77] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/users/7c31e5107fca4386ab7dffdeb4815b90 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:08.202921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39992046-beb4-4af8-b744-c1084b87aa48 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.203210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39992046-beb4-4af8-b744-c1084b87aa48 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.203488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39992046-beb4-4af8-b744-c1084b87aa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.222558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-39992046-beb4-4af8-b744-c1084b87aa48 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:08.223779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-39992046-beb4-4af8-b744-c1084b87aa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:08.238344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00320c19-7d1b-4aa5-9264-420c784eb955 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.272631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072911-c43b-482f-baee-babfc8e7e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.273297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072911-c43b-482f-baee-babfc8e7e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.273583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072911-c43b-482f-baee-babfc8e7e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.273862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8072911-c43b-482f-baee-babfc8e7e3a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.291390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 42/78] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:08.300456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39992046-beb4-4af8-b744-c1084b87aa48 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.349227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.356335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8072911-c43b-482f-baee-babfc8e7e3a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:08.357872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8072911-c43b-482f-baee-babfc8e7e3a9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:08.359903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.393341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39992046-beb4-4af8-b744-c1084b87aa48 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.426962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60014635-b9d6-4b00-8b72-907e42cc42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.427753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014635-b9d6-4b00-8b72-907e42cc42bf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.428045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014635-b9d6-4b00-8b72-907e42cc42bf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.428347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60014635-b9d6-4b00-8b72-907e42cc42bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.429513 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60014635-b9d6-4b00-8b72-907e42cc42bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:08.430967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60014635-b9d6-4b00-8b72-907e42cc42bf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:08.432639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 43/79] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:08.433404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60014635-b9d6-4b00-8b72-907e42cc42bf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.461247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 37/80] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:08.462038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072911-c43b-482f-baee-babfc8e7e3a9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.543057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60014635-b9d6-4b00-8b72-907e42cc42bf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.561325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8072911-c43b-482f-baee-babfc8e7e3a9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.562872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.566664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.580830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.581472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.581814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.582505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.582779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:08.583084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:08.585913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:08.593538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 44/81] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:08.594214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.598907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec442-a723-4a4d-9f8f-14ad9591dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.599580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec442-a723-4a4d-9f8f-14ad9591dc3a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.599869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec442-a723-4a4d-9f8f-14ad9591dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.600185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec442-a723-4a4d-9f8f-14ad9591dc3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.670917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aec442-a723-4a4d-9f8f-14ad9591dc3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:08.672497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aec442-a723-4a4d-9f8f-14ad9591dc3a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:08.696689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d8397-ca3a-44ab-8a65-09eb1f4e16a2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.730736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29296a-1c7a-43eb-b1ec-e91fc2dd0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.731456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29296a-1c7a-43eb-b1ec-e91fc2dd0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.731746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29296a-1c7a-43eb-b1ec-e91fc2dd0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.732021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29296a-1c7a-43eb-b1ec-e91fc2dd0cf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.742613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29296a-1c7a-43eb-b1ec-e91fc2dd0cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7f29296a-1c7a-43eb-b1ec-e91fc2dd0cf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:08.750846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:08.751701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 45/82] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:08.752997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29296a-1c7a-43eb-b1ec-e91fc2dd0cf9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.772781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 38/83] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:08.773941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec442-a723-4a4d-9f8f-14ad9591dc3a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.776513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.801876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:08.857651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29296a-1c7a-43eb-b1ec-e91fc2dd0cf9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.881776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec442-a723-4a4d-9f8f-14ad9591dc3a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:08.892469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef1e40-59e4-42fb-97ee-dfe0beb0d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.893154 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef1e40-59e4-42fb-97ee-dfe0beb0d6d6 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.893442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef1e40-59e4-42fb-97ee-dfe0beb0d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.893721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef1e40-59e4-42fb-97ee-dfe0beb0d6d6 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.894453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef1e40-59e4-42fb-97ee-dfe0beb0d6d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:08.895928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef1e40-59e4-42fb-97ee-dfe0beb0d6d6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:08.915888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 46/84] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:08 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:03:08.916588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef1e40-59e4-42fb-97ee-dfe0beb0d6d6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:08.925020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6721a-7085-4bfd-aff6-196de8245f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:08.925997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6721a-7085-4bfd-aff6-196de8245f12 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:08.926287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6721a-7085-4bfd-aff6-196de8245f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:08.926593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6721a-7085-4bfd-aff6-196de8245f12 None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:08.928135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6721a-7085-4bfd-aff6-196de8245f12 None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:08.929701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6721a-7085-4bfd-aff6-196de8245f12 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:08.931628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 39/85] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:08.932493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6721a-7085-4bfd-aff6-196de8245f12 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.021127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:09.035803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef1e40-59e4-42fb-97ee-dfe0beb0d6d6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:09.037584 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:09.060306 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6721a-7085-4bfd-aff6-196de8245f12 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:09.076323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6bd0-1345-4c9d-a66b-b78aae44df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:09.077242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6bd0-1345-4c9d-a66b-b78aae44df6b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:09.077530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6bd0-1345-4c9d-a66b-b78aae44df6b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:09.077808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6bd0-1345-4c9d-a66b-b78aae44df6b None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:09.079034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a6bd0-1345-4c9d-a66b-b78aae44df6b None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:09.080547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a6bd0-1345-4c9d-a66b-b78aae44df6b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:09.082206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 47/86] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:09.083102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6bd0-1345-4c9d-a66b-b78aae44df6b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.107147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:09.110172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:09.110725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:09.111169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:09.112166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:09.112791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:09.114674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:09.125342 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 40/87] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:09.125937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.215543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6bd0-1345-4c9d-a66b-b78aae44df6b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:09.265512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8e5c5-c288-4ce8-a368-9e2a225bb89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:09.266693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e5c5-c288-4ce8-a368-9e2a225bb89a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:09.267554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e5c5-c288-4ce8-a368-9e2a225bb89a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:09.267850 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8e5c5-c288-4ce8-a368-9e2a225bb89a None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:09.269758 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8e5c5-c288-4ce8-a368-9e2a225bb89a None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:09.272072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8e5c5-c288-4ce8-a368-9e2a225bb89a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:09.274794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 48/88] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:09 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:09.275591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8e5c5-c288-4ce8-a368-9e2a225bb89a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.276213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84f3a-4630-486f-a63e-535aa09edde9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:09.308305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:09.316949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:09.317625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:09.317910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:09.318212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:09.319030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] RBAC: Adding query filter params (role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc, user.id=73a04115ece5418abffc9b8ea0852084) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:09.319344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:09.320924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:09.327298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 41/89] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:09 2022] GET /identity/v3/role_assignments?user.id=73a04115ece5418abffc9b8ea0852084&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:09.332285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.332965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:09.412640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8e5c5-c288-4ce8-a368-9e2a225bb89a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:09.454404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dc114-0087-4708-bfa1-265dce621cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:09.455203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc114-0087-4708-bfa1-265dce621cdd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:09.455563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc114-0087-4708-bfa1-265dce621cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:09.455918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dc114-0087-4708-bfa1-265dce621cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:09.536353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dc114-0087-4708-bfa1-265dce621cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:09.537896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dc114-0087-4708-bfa1-265dce621cdd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:09.592504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:09.623484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6a2c9-4c61-4e12-88f8-0aa74f44ad4e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:09.656143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 49/90] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:09.656960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dc114-0087-4708-bfa1-265dce621cdd None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.672200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34721472-8c52-4fec-86fb-3914335e1979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:09.673595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721472-8c52-4fec-86fb-3914335e1979 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:09.673890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721472-8c52-4fec-86fb-3914335e1979 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:09.674165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721472-8c52-4fec-86fb-3914335e1979 None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:09.675410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34721472-8c52-4fec-86fb-3914335e1979 None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:09.676918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34721472-8c52-4fec-86fb-3914335e1979 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:09.679129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 42/91] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:09 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:09.679754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34721472-8c52-4fec-86fb-3914335e1979 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.756935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:09.826564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34721472-8c52-4fec-86fb-3914335e1979 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:09.866271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b556-2056-439c-8679-46fbe16ea159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:09.867757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b556-2056-439c-8679-46fbe16ea159 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:09.868050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b556-2056-439c-8679-46fbe16ea159 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:09.868363 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1b556-2056-439c-8679-46fbe16ea159 None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:09.869475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dc114-0087-4708-bfa1-265dce621cdd None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:09.869655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1b556-2056-439c-8679-46fbe16ea159 None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:09.871254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1b556-2056-439c-8679-46fbe16ea159 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:09.873867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 43/92] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:09 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:09.875321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b556-2056-439c-8679-46fbe16ea159 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.959229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:09.959895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:09.960246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:09.960533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:09.961386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc, user.id=7c31e5107fca4386ab7dffdeb4815b90) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:09.961701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:09.963183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:09.972793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 50/93] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:09 2022] GET /identity/v3/role_assignments?user.id=7c31e5107fca4386ab7dffdeb4815b90&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:09.973636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:09.984417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:10.074473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1b556-2056-439c-8679-46fbe16ea159 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:10.167474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:10.180187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393a24a-f962-4b50-b20d-da6016952bf9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:10.184824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ecf7b-511d-4c49-b45a-b8b2e3853ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:10.185779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecf7b-511d-4c49-b45a-b8b2e3853ede None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:10.186291 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecf7b-511d-4c49-b45a-b8b2e3853ede None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:10.186815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ecf7b-511d-4c49-b45a-b8b2e3853ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:10.248788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:10.249616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:10.249913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:10.250202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:10.251088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] RBAC: Adding query filter params (role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc, user.id=73a04115ece5418abffc9b8ea0852084) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:10.251570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:10.253202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:10.268565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 51/94] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:09 2022] GET /identity/v3/role_assignments?user.id=73a04115ece5418abffc9b8ea0852084&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:10.307711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ecf7b-511d-4c49-b45a-b8b2e3853ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:10.313617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ecf7b-511d-4c49-b45a-b8b2e3853ede None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:10.447799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 44/95] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:10.457265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:10.563378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:10.613437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4797b-36ed-4595-a461-cc9b937970d4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:10.662542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa83e78-0cc9-47f2-99a8-23f8ba057a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:10.663437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83e78-0cc9-47f2-99a8-23f8ba057a94 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:10.663719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83e78-0cc9-47f2-99a8-23f8ba057a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:10.663999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa83e78-0cc9-47f2-99a8-23f8ba057a94 None admin] PATH_INFO: `/v3/projects/71b015a2b8364afe8d1c20e6d0cbb0bd` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:10.665241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa83e78-0cc9-47f2-99a8-23f8ba057a94 None admin] RBAC: Authorizing `identity:get_project(project_id=71b015a2b8364afe8d1c20e6d0cbb0bd)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:10.666714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa83e78-0cc9-47f2-99a8-23f8ba057a94 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:10.668677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 52/96] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:10 2022] GET /identity/v3/projects/71b015a2b8364afe8d1c20e6d0cbb0bd => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:10.674525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ecf7b-511d-4c49-b45a-b8b2e3853ede None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:10.720743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:10.808466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ecf7b-511d-4c49-b45a-b8b2e3853ede None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:10.855623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524132e-179d-4d4b-9966-33efb743c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:10.856326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524132e-179d-4d4b-9966-33efb743c427 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:10.856614 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524132e-179d-4d4b-9966-33efb743c427 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:10.856895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524132e-179d-4d4b-9966-33efb743c427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:10.857742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524132e-179d-4d4b-9966-33efb743c427 None admin] RBAC: Adding query filter params (role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=71b015a2b8364afe8d1c20e6d0cbb0bd, user.id=73a04115ece5418abffc9b8ea0852084) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:10.858054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524132e-179d-4d4b-9966-33efb743c427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:10.859693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524132e-179d-4d4b-9966-33efb743c427 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:10.866042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 45/97] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:10 2022] GET /identity/v3/role_assignments?user.id=73a04115ece5418abffc9b8ea0852084&scope.project.id=71b015a2b8364afe8d1c20e6d0cbb0bd&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:11.415396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb8763-fe62-44d9-bf2d-9fb7825a6546 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:11.415934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb8763-fe62-44d9-bf2d-9fb7825a6546 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:11.415934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb8763-fe62-44d9-bf2d-9fb7825a6546 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:11.417498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 53/98] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:11.423601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8344d-609c-4233-bf9e-63901e695b47 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:11.424067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8344d-609c-4233-bf9e-63901e695b47 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:11.424321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8344d-609c-4233-bf9e-63901e695b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:11.446542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2ee8344d-609c-4233-bf9e-63901e695b47 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:11.447767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2ee8344d-609c-4233-bf9e-63901e695b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:11.556154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 46/99] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:11.590834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb8763-fe62-44d9-bf2d-9fb7825a6546 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:11.736674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb8763-fe62-44d9-bf2d-9fb7825a6546 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:11.779565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459622ce-5464-45ae-876f-d11d4e259666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:11.780930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459622ce-5464-45ae-876f-d11d4e259666 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:11.781216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459622ce-5464-45ae-876f-d11d4e259666 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:11.781490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459622ce-5464-45ae-876f-d11d4e259666 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:11.783528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:11.798016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459622ce-5464-45ae-876f-d11d4e259666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-459622ce-5464-45ae-876f-d11d4e259666 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:11.805910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:11.806775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:11.807621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 54/100] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:11.814837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8344d-609c-4233-bf9e-63901e695b47 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:11.852518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:11.880844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a780d6-f479-460b-b394-09becdf907b5 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:11.881145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a780d6-f479-460b-b394-09becdf907b5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:11.881400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a780d6-f479-460b-b394-09becdf907b5 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:11.882858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 55/101] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:11.887910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d5382-2912-41a7-8f9e-7c60b795ddd1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:11.888220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d5382-2912-41a7-8f9e-7c60b795ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:11.888500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d5382-2912-41a7-8f9e-7c60b795ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:11.919903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-537d5382-2912-41a7-8f9e-7c60b795ddd1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:11.921817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-537d5382-2912-41a7-8f9e-7c60b795ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:11.962965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8344d-609c-4233-bf9e-63901e695b47 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:11.999095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:11.999693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:11.999981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:12.000290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:12.001078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:12.001393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:12.002815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:12.011591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 47/102] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:12.017827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:12.046792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 56/103] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:12.071443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d5382-2912-41a7-8f9e-7c60b795ddd1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:12.225940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:12.261066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331da39c-b332-4e6c-8ece-dba2e998c3e6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:12.288367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d5382-2912-41a7-8f9e-7c60b795ddd1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:12.329891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:12.345197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c742dc3-d9b2-4d58-9ed5-e595f3b77a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:12.346137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c742dc3-d9b2-4d58-9ed5-e595f3b77a14 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:12.346427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c742dc3-d9b2-4d58-9ed5-e595f3b77a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:12.346711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c742dc3-d9b2-4d58-9ed5-e595f3b77a14 None admin] PATH_INFO: `/v3/users/f52b946921504f2b81c190b058e18a96` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:12.351132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a6124-dd8e-4a33-904b-13e015305f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:12.353077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a6124-dd8e-4a33-904b-13e015305f97 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:12.353374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a6124-dd8e-4a33-904b-13e015305f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:12.353664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a6124-dd8e-4a33-904b-13e015305f97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:12.358976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a6124-dd8e-4a33-904b-13e015305f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:12.360524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a6124-dd8e-4a33-904b-13e015305f97 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:12.362455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 57/104] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:12.372385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c742dc3-d9b2-4d58-9ed5-e595f3b77a14 None admin] RBAC: Authorizing `identity:get_user(user_id=f52b946921504f2b81c190b058e18a96)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:12.372860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a6124-dd8e-4a33-904b-13e015305f97 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:12.373876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c742dc3-d9b2-4d58-9ed5-e595f3b77a14 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:12.376189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 48/105] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:12 2022] GET /identity/v3/users/f52b946921504f2b81c190b058e18a96 => generated 289 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:12.381926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c742dc3-d9b2-4d58-9ed5-e595f3b77a14 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:12.487395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c742dc3-d9b2-4d58-9ed5-e595f3b77a14 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:12.536845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ffd94-ee4f-488f-8d47-b73a68732ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:12.537515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ffd94-ee4f-488f-8d47-b73a68732ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:12.537795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ffd94-ee4f-488f-8d47-b73a68732ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:12.538067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ffd94-ee4f-488f-8d47-b73a68732ba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:12.558691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:12.598336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a6124-dd8e-4a33-904b-13e015305f97 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:12.646148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90cdd-71b7-4424-b2d9-687ba32fe5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:12.647370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90cdd-71b7-4424-b2d9-687ba32fe5ab None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:12.649182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90cdd-71b7-4424-b2d9-687ba32fe5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:12.650249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90cdd-71b7-4424-b2d9-687ba32fe5ab None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:12.651400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90cdd-71b7-4424-b2d9-687ba32fe5ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:12.653753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90cdd-71b7-4424-b2d9-687ba32fe5ab None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:12.680135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ffd94-ee4f-488f-8d47-b73a68732ba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:12.681993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ffd94-ee4f-488f-8d47-b73a68732ba5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:12.720701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 58/106] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:03:12 2022] POST /identity/v3/projects => generated 302 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:03:12.722560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb9f4-14dc-4123-800e-80ea4b42144e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:12.723935 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb9f4-14dc-4123-800e-80ea4b42144e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:12.724623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbb9f4-14dc-4123-800e-80ea4b42144e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:12.727545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 59/107] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:12.733764 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaad9d-ed59-4846-adb0-ffaeb6beaa3c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:12.734374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaad9d-ed59-4846-adb0-ffaeb6beaa3c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:12.734875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaad9d-ed59-4846-adb0-ffaeb6beaa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:12.765874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9feaad9d-ed59-4846-adb0-ffaeb6beaa3c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:12.767195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9feaad9d-ed59-4846-adb0-ffaeb6beaa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:12.881784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:12.911289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 60/108] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:12.937840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaad9d-ed59-4846-adb0-ffaeb6beaa3c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:12.939551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 49/109] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:03:12.945125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ffd94-ee4f-488f-8d47-b73a68732ba5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:13.052244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaad9d-ed59-4846-adb0-ffaeb6beaa3c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:13.063767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:13.089546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6571b-08d8-46ee-bf44-2d57d19de66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:13.090429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6571b-08d8-46ee-bf44-2d57d19de66e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.090718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6571b-08d8-46ee-bf44-2d57d19de66e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.091001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6571b-08d8-46ee-bf44-2d57d19de66e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.103542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6571b-08d8-46ee-bf44-2d57d19de66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-87c6571b-08d8-46ee-bf44-2d57d19de66e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:13.111733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:13.112730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:13.113526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:13.117954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 61/110] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:13.119243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6571b-08d8-46ee-bf44-2d57d19de66e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:13.160551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:13.174569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ffd94-ee4f-488f-8d47-b73a68732ba5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:13.239073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6571b-08d8-46ee-bf44-2d57d19de66e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:13.279497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:13.280354 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.280651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.281437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.282227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:13.282544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:13.283981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:13.293317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 62/111] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:13.299100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:13.301029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4ef00-84c9-4fac-8c25-519b0fd9f6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:13.301928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4ef00-84c9-4fac-8c25-519b0fd9f6fb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.302217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4ef00-84c9-4fac-8c25-519b0fd9f6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.302495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4ef00-84c9-4fac-8c25-519b0fd9f6fb None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.309011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4ef00-84c9-4fac-8c25-519b0fd9f6fb None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:13.310534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4ef00-84c9-4fac-8c25-519b0fd9f6fb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:13.313247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 50/112] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:12 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:13.319075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4ef00-84c9-4fac-8c25-519b0fd9f6fb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:13.420594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:13.432835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcc76b-2d29-47cd-92b2-3cdd50f8764b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:13.524932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc045f-c0a1-4c74-8435-6d1b704cc554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:13.525840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc045f-c0a1-4c74-8435-6d1b704cc554 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.526130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc045f-c0a1-4c74-8435-6d1b704cc554 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.526408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc045f-c0a1-4c74-8435-6d1b704cc554 None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.531294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc045f-c0a1-4c74-8435-6d1b704cc554 None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:13.532824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc045f-c0a1-4c74-8435-6d1b704cc554 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:13.534555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 63/113] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:13 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:13.535812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dfd6a-47fa-4693-b493-ee38c6384174 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.536192 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dfd6a-47fa-4693-b493-ee38c6384174 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.536479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dfd6a-47fa-4693-b493-ee38c6384174 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.537741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 64/114] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:13.538252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4ef00-84c9-4fac-8c25-519b0fd9f6fb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:13.543331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dfd6a-47fa-4693-b493-ee38c6384174 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:13.585409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:13.628427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fba98-9f61-44b7-aa2a-14de2277e273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:13.629110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fba98-9f61-44b7-aa2a-14de2277e273 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.629398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fba98-9f61-44b7-aa2a-14de2277e273 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.629674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fba98-9f61-44b7-aa2a-14de2277e273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.630681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fba98-9f61-44b7-aa2a-14de2277e273 None admin] RBAC: Adding query filter params (role.id=830a10d3893c4f1ba36a2145058dfac3, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc, user.id=f52b946921504f2b81c190b058e18a96) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:13.631147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fba98-9f61-44b7-aa2a-14de2277e273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:13.632999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fba98-9f61-44b7-aa2a-14de2277e273 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:13.645452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 51/115] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:13 2022] GET /identity/v3/role_assignments?user.id=f52b946921504f2b81c190b058e18a96&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=830a10d3893c4f1ba36a2145058dfac3 => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:13.646996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fa69b-eaeb-4b4a-8e8f-dce534c2429f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.647436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fa69b-eaeb-4b4a-8e8f-dce534c2429f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.647856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fa69b-eaeb-4b4a-8e8f-dce534c2429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.678923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ed0fa69b-eaeb-4b4a-8e8f-dce534c2429f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:13.680529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ed0fa69b-eaeb-4b4a-8e8f-dce534c2429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:13.683539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dfd6a-47fa-4693-b493-ee38c6384174 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:13.774993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b149dd-4838-4016-ba89-a4a9c139081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:13.776797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b149dd-4838-4016-ba89-a4a9c139081e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.777484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b149dd-4838-4016-ba89-a4a9c139081e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.778124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b149dd-4838-4016-ba89-a4a9c139081e None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.780363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b149dd-4838-4016-ba89-a4a9c139081e None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:13.783076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b149dd-4838-4016-ba89-a4a9c139081e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:13.786451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 65/116] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:13 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:13.794681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d813-14f3-4c06-bd36-fb0fe3aabc60 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.795431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d813-14f3-4c06-bd36-fb0fe3aabc60 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.796667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1d813-14f3-4c06-bd36-fb0fe3aabc60 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.799230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 66/117] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:13.803077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d813-14f3-4c06-bd36-fb0fe3aabc60 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:13.880298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:13.882533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 52/118] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:13.884311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e518d-de13-4e54-8130-11712323512e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:13.884606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e518d-de13-4e54-8130-11712323512e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:13.884994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e518d-de13-4e54-8130-11712323512e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:13.910344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8b2e518d-de13-4e54-8130-11712323512e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:13.912180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b2e518d-de13-4e54-8130-11712323512e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:13.987580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1d813-14f3-4c06-bd36-fb0fe3aabc60 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:14.003684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 53/119] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:14.006250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c10c8-1ed1-49aa-bfdf-3e906042e29d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.006717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c10c8-1ed1-49aa-bfdf-3e906042e29d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.007160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c10c8-1ed1-49aa-bfdf-3e906042e29d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.009538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 54/120] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:14.010426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c10c8-1ed1-49aa-bfdf-3e906042e29d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:14.032531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180239c-bee0-4811-b4b3-389b6b5bd2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:14.033955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180239c-bee0-4811-b4b3-389b6b5bd2ee None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.034518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180239c-bee0-4811-b4b3-389b6b5bd2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.034997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180239c-bee0-4811-b4b3-389b6b5bd2ee None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/users/73a04115ece5418abffc9b8ea0852084/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.037764 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180239c-bee0-4811-b4b3-389b6b5bd2ee None admin] RBAC: Authorizing `identity:create_grant(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc, user_id=73a04115ece5418abffc9b8ea0852084, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:14.039602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180239c-bee0-4811-b4b3-389b6b5bd2ee None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:14.055957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 67/121] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:13 2022] PUT /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/users/73a04115ece5418abffc9b8ea0852084/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:03:14.063960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:14.065661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feef02-82ac-4361-852e-9f6856fe7abb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.066221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feef02-82ac-4361-852e-9f6856fe7abb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.066504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feef02-82ac-4361-852e-9f6856fe7abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.101327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-21feef02-82ac-4361-852e-9f6856fe7abb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:14.102833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-21feef02-82ac-4361-852e-9f6856fe7abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:14.149116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c10c8-1ed1-49aa-bfdf-3e906042e29d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:14.194827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9395532-b8ec-4c85-aec4-80d19375424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:14.196084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9395532-b8ec-4c85-aec4-80d19375424d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.196641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9395532-b8ec-4c85-aec4-80d19375424d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.197780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9395532-b8ec-4c85-aec4-80d19375424d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.213011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9395532-b8ec-4c85-aec4-80d19375424d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a9395532-b8ec-4c85-aec4-80d19375424d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:14.223403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:14.224405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:14.225181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:14.228486 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 55/122] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:14.229787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9395532-b8ec-4c85-aec4-80d19375424d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:14.283566 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 68/123] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:14.284382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feef02-82ac-4361-852e-9f6856fe7abb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:14.323680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:14.362418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:14.366687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9395532-b8ec-4c85-aec4-80d19375424d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:14.409877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7f59-9a07-481a-a738-9cc232748ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:14.411787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7f59-9a07-481a-a738-9cc232748ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.413990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7f59-9a07-481a-a738-9cc232748ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.415327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7f59-9a07-481a-a738-9cc232748ef1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.437302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b7f59-9a07-481a-a738-9cc232748ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:14.451895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feef02-82ac-4361-852e-9f6856fe7abb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bd2b7f59-9a07-481a-a738-9cc232748ef1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:14.455239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:14.456169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:14.456944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:14.465135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 56/124] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:14.466466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7f59-9a07-481a-a738-9cc232748ef1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:14.522864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:14.525289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.525812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.529236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.529359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:14.529686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:14.531727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:14.546392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 69/125] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:14.547651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:14.673238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7f59-9a07-481a-a738-9cc232748ef1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:14.711029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d190df-3f82-4fa4-8bcb-b70cdc9a3c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:14.712219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d190df-3f82-4fa4-8bcb-b70cdc9a3c2e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.712710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d190df-3f82-4fa4-8bcb-b70cdc9a3c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.713221 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d190df-3f82-4fa4-8bcb-b70cdc9a3c2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.724411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d190df-3f82-4fa4-8bcb-b70cdc9a3c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:14.729685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-44d190df-3f82-4fa4-8bcb-b70cdc9a3c2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:14.736916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:14.737826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:14.738598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:14.741096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 57/126] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:14.746967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d190df-3f82-4fa4-8bcb-b70cdc9a3c2e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:14.757742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35ebf3-8d41-4ced-acb6-a2b328a4a47b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:14.776520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:14.828912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:14.829503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.829793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.830107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.830978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:14.831291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:14.832722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:14.851608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 70/127] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:14.852380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:14.858212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d190df-3f82-4fa4-8bcb-b70cdc9a3c2e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:14.895567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cae399-ee3b-4fd1-a3a0-43c509623ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:14.897004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae399-ee3b-4fd1-a3a0-43c509623ffa None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:14.897493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae399-ee3b-4fd1-a3a0-43c509623ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:14.897983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cae399-ee3b-4fd1-a3a0-43c509623ffa None admin] PATH_INFO: `/v3/users/7c31e5107fca4386ab7dffdeb4815b90` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:14.899569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cae399-ee3b-4fd1-a3a0-43c509623ffa None admin] RBAC: Authorizing `identity:get_user(user_id=7c31e5107fca4386ab7dffdeb4815b90)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:14.901484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cae399-ee3b-4fd1-a3a0-43c509623ffa None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:14.903495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 58/128] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:14 2022] GET /identity/v3/users/7c31e5107fca4386ab7dffdeb4815b90 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:14.904736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cae399-ee3b-4fd1-a3a0-43c509623ffa None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:15.011539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cae399-ee3b-4fd1-a3a0-43c509623ffa None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:15.024492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:15.049742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66393865-2d10-4b6d-ac91-9a720248aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:15.051078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393865-2d10-4b6d-ac91-9a720248aabe None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.051599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393865-2d10-4b6d-ac91-9a720248aabe None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.052174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393865-2d10-4b6d-ac91-9a720248aabe None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.053881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66393865-2d10-4b6d-ac91-9a720248aabe None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:15.055583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66393865-2d10-4b6d-ac91-9a720248aabe None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:15.057626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 59/129] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:14 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:15.058699 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66393865-2d10-4b6d-ac91-9a720248aabe None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:15.106141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2599af-1440-4224-a2b8-95aebf8769b8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:15.167479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66393865-2d10-4b6d-ac91-9a720248aabe None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:15.202703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:15.203794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.204309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.204806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.207777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:15.208362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:15.210061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:15.220282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 71/130] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:15.225395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:15.239658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:15.258224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7221e0-5049-4098-8f76-f6e25563f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:15.259672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7221e0-5049-4098-8f76-f6e25563f99c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.259963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7221e0-5049-4098-8f76-f6e25563f99c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.260271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7221e0-5049-4098-8f76-f6e25563f99c None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.265505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7221e0-5049-4098-8f76-f6e25563f99c None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:15.268091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7221e0-5049-4098-8f76-f6e25563f99c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:15.272301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 60/131] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:15 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:15.274299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7221e0-5049-4098-8f76-f6e25563f99c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:15.324486 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:15.409627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9d588-9233-4f6a-b8b2-588b57ba5a16 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:15.474718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7221e0-5049-4098-8f76-f6e25563f99c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:15.476726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4866398-5be1-4ec2-99bf-5dbe85fc893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:15.477727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4866398-5be1-4ec2-99bf-5dbe85fc893b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.478015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4866398-5be1-4ec2-99bf-5dbe85fc893b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.478295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4866398-5be1-4ec2-99bf-5dbe85fc893b None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.479677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4866398-5be1-4ec2-99bf-5dbe85fc893b None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:15.481185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4866398-5be1-4ec2-99bf-5dbe85fc893b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:15.482907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 72/132] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:15 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:15.483686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4866398-5be1-4ec2-99bf-5dbe85fc893b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:15.546982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6301432-4723-486d-93f4-812f086d4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:15.547871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6301432-4723-486d-93f4-812f086d4466 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.548184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6301432-4723-486d-93f4-812f086d4466 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.548465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6301432-4723-486d-93f4-812f086d4466 None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.550682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6301432-4723-486d-93f4-812f086d4466 None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:15.552204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6301432-4723-486d-93f4-812f086d4466 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:15.553899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 61/133] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:15 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:15.554647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6301432-4723-486d-93f4-812f086d4466 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:15.648967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:15.677580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4866398-5be1-4ec2-99bf-5dbe85fc893b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:15.711742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:15.716471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547877fd-0f34-4a34-938e-262b29c37a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:15.717878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547877fd-0f34-4a34-938e-262b29c37a5a None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.718309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547877fd-0f34-4a34-938e-262b29c37a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.718587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547877fd-0f34-4a34-938e-262b29c37a5a None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/users/7c31e5107fca4386ab7dffdeb4815b90/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.721357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547877fd-0f34-4a34-938e-262b29c37a5a None admin] RBAC: Authorizing `identity:create_grant(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc, user_id=7c31e5107fca4386ab7dffdeb4815b90, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:15.722821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547877fd-0f34-4a34-938e-262b29c37a5a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:15.722938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6301432-4723-486d-93f4-812f086d4466 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:15.739294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 73/134] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:15 2022] PUT /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/users/7c31e5107fca4386ab7dffdeb4815b90/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:15.740634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547877fd-0f34-4a34-938e-262b29c37a5a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:15.786116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6961-82c8-4681-b935-9261dad3bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:15.787130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6961-82c8-4681-b935-9261dad3bf7e None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.787422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6961-82c8-4681-b935-9261dad3bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.787746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6961-82c8-4681-b935-9261dad3bf7e None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/users/73a04115ece5418abffc9b8ea0852084/roles/9189b2de997c4913bc3d3b88754b8966` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.793034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6961-82c8-4681-b935-9261dad3bf7e None admin] RBAC: Authorizing `identity:create_grant(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc, user_id=73a04115ece5418abffc9b8ea0852084, role_id=9189b2de997c4913bc3d3b88754b8966)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:15.794653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6961-82c8-4681-b935-9261dad3bf7e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:15.825166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 62/135] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:15 2022] PUT /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/users/73a04115ece5418abffc9b8ea0852084/roles/9189b2de997c4913bc3d3b88754b8966 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:15.826583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db36c3-2b20-4de1-9279-2d6ef32c8d4f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.826876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db36c3-2b20-4de1-9279-2d6ef32c8d4f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.827242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db36c3-2b20-4de1-9279-2d6ef32c8d4f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.828668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 63/136] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:15.836927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16243b70-cb23-4539-9472-25bb53ecd9b0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.837264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16243b70-cb23-4539-9472-25bb53ecd9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.837550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16243b70-cb23-4539-9472-25bb53ecd9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.869490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-16243b70-cb23-4539-9472-25bb53ecd9b0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:15.870761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-16243b70-cb23-4539-9472-25bb53ecd9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:15.873306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547877fd-0f34-4a34-938e-262b29c37a5a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:15.918161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a807f-be78-404d-9553-0c08f39af229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:15.919048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a807f-be78-404d-9553-0c08f39af229 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:15.919334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a807f-be78-404d-9553-0c08f39af229 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:15.919613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a807f-be78-404d-9553-0c08f39af229 None admin] PATH_INFO: `/v3/projects/71b015a2b8364afe8d1c20e6d0cbb0bd` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:15.922015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a807f-be78-404d-9553-0c08f39af229 None admin] RBAC: Authorizing `identity:get_project(project_id=71b015a2b8364afe8d1c20e6d0cbb0bd)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:15.923829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a807f-be78-404d-9553-0c08f39af229 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:15.925913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 74/137] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:15 2022] GET /identity/v3/projects/71b015a2b8364afe8d1c20e6d0cbb0bd => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:15.932634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a807f-be78-404d-9553-0c08f39af229 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:15.942108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:16.021934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 64/138] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:16.056428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16243b70-cb23-4539-9472-25bb53ecd9b0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:16.103149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a807f-be78-404d-9553-0c08f39af229 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:16.149574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc58cf-71fe-4363-8e64-ee58e2e7587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:16.150856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc58cf-71fe-4363-8e64-ee58e2e7587b None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.151370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc58cf-71fe-4363-8e64-ee58e2e7587b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.151940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc58cf-71fe-4363-8e64-ee58e2e7587b None admin] PATH_INFO: `/v3/projects/71b015a2b8364afe8d1c20e6d0cbb0bd/users/73a04115ece5418abffc9b8ea0852084/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.154331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc58cf-71fe-4363-8e64-ee58e2e7587b None admin] RBAC: Authorizing `identity:create_grant(project_id=71b015a2b8364afe8d1c20e6d0cbb0bd, user_id=73a04115ece5418abffc9b8ea0852084, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:16.156612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc58cf-71fe-4363-8e64-ee58e2e7587b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:16.158553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:16.182202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 75/139] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:15 2022] PUT /identity/v3/projects/71b015a2b8364afe8d1c20e6d0cbb0bd/users/73a04115ece5418abffc9b8ea0852084/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:03:16.184520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16243b70-cb23-4539-9472-25bb53ecd9b0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:16.204513 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ddecb-7598-408a-99b3-6b12abeef499 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.204953 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ddecb-7598-408a-99b3-6b12abeef499 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.205338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ddecb-7598-408a-99b3-6b12abeef499 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.207262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 76/140] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:16.214350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc529b-8671-40d1-b5e7-c9977eafd128 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.214776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc529b-8671-40d1-b5e7-c9977eafd128 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.215207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc529b-8671-40d1-b5e7-c9977eafd128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.249142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2f815-8d30-4a8f-a0f2-37d8a11b54f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:16.250327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2f815-8d30-4a8f-a0f2-37d8a11b54f9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.250789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2f815-8d30-4a8f-a0f2-37d8a11b54f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.251246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2f815-8d30-4a8f-a0f2-37d8a11b54f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.253263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-25cc529b-8671-40d1-b5e7-c9977eafd128 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:16.254191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2f815-8d30-4a8f-a0f2-37d8a11b54f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:16.255743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-25cc529b-8671-40d1-b5e7-c9977eafd128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:16.258617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2f815-8d30-4a8f-a0f2-37d8a11b54f9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:16.262538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 65/141] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:16.270151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2f815-8d30-4a8f-a0f2-37d8a11b54f9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:16.398704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:16.415731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 77/142] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:16.427549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2f815-8d30-4a8f-a0f2-37d8a11b54f9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:16.457664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc529b-8671-40d1-b5e7-c9977eafd128 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:16.472159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c104b-0db0-484e-a0c2-3f1f7bf45cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:16.473120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c104b-0db0-484e-a0c2-3f1f7bf45cf5 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.473590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c104b-0db0-484e-a0c2-3f1f7bf45cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.474030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c104b-0db0-484e-a0c2-3f1f7bf45cf5 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.474906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c104b-0db0-484e-a0c2-3f1f7bf45cf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:16.476541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c104b-0db0-484e-a0c2-3f1f7bf45cf5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:16.515389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 66/143] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:16 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:03:16.607697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc529b-8671-40d1-b5e7-c9977eafd128 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:16.656092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bddd3-84c0-49da-997b-5a277d7b8e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:16.657168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bddd3-84c0-49da-997b-5a277d7b8e10 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.657457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bddd3-84c0-49da-997b-5a277d7b8e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.657735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bddd3-84c0-49da-997b-5a277d7b8e10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.676056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bddd3-84c0-49da-997b-5a277d7b8e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ae6bddd3-84c0-49da-997b-5a277d7b8e10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:16.684117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:16.685014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:16.685872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 78/144] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:16.691686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c104b-0db0-484e-a0c2-3f1f7bf45cf5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:16.700016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:16.822076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c104b-0db0-484e-a0c2-3f1f7bf45cf5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:16.866813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d860f-83d1-4a82-accd-8df5e7621026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:16.867866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d860f-83d1-4a82-accd-8df5e7621026 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.868373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d860f-83d1-4a82-accd-8df5e7621026 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.868866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d860f-83d1-4a82-accd-8df5e7621026 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.869832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d860f-83d1-4a82-accd-8df5e7621026 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:16.870336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d860f-83d1-4a82-accd-8df5e7621026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:16.871965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d860f-83d1-4a82-accd-8df5e7621026 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:16.886142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 67/145] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:16.892304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bddd3-84c0-49da-997b-5a277d7b8e10 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:16.919896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ecef0-ea18-46b5-9230-c9babbcf6a30 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.920552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ecef0-ea18-46b5-9230-c9babbcf6a30 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.921070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ecef0-ea18-46b5-9230-c9babbcf6a30 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.922660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 68/146] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:16.930314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823df7f-3edb-472b-ad23-b1257a75a0b4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:16.930664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823df7f-3edb-472b-ad23-b1257a75a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:16.930883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823df7f-3edb-472b-ad23-b1257a75a0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:16.951856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0823df7f-3edb-472b-ad23-b1257a75a0b4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:16.953752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0823df7f-3edb-472b-ad23-b1257a75a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:17.000462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:17.020650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:17.028017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 69/147] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:17.052434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823df7f-3edb-472b-ad23-b1257a75a0b4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:17.126791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bddd3-84c0-49da-997b-5a277d7b8e10 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:17.168039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823df7f-3edb-472b-ad23-b1257a75a0b4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:17.208850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a28c9-55d7-46fa-91f6-9cc1b71a3100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:17.209983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a28c9-55d7-46fa-91f6-9cc1b71a3100 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:17.210407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a28c9-55d7-46fa-91f6-9cc1b71a3100 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:17.210828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a28c9-55d7-46fa-91f6-9cc1b71a3100 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:17.215580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bde4d-4631-403c-84fd-1a9c03930008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:17.216554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bde4d-4631-403c-84fd-1a9c03930008 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:17.216796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bde4d-4631-403c-84fd-1a9c03930008 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:17.217092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bde4d-4631-403c-84fd-1a9c03930008 None admin] PATH_INFO: `/v3/users/f52b946921504f2b81c190b058e18a96` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:17.218355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bde4d-4631-403c-84fd-1a9c03930008 None admin] RBAC: Authorizing `identity:get_user(user_id=f52b946921504f2b81c190b058e18a96)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:17.219847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bde4d-4631-403c-84fd-1a9c03930008 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:17.223647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a28c9-55d7-46fa-91f6-9cc1b71a3100 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:17.225763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 79/148] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:16 2022] GET /identity/v3/users/f52b946921504f2b81c190b058e18a96 => generated 289 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:17.229110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bde4d-4631-403c-84fd-1a9c03930008 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-177a28c9-55d7-46fa-91f6-9cc1b71a3100 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:17.232786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:17.233882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:17.234889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:17.236850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 70/149] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:17.245326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a28c9-55d7-46fa-91f6-9cc1b71a3100 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:17.313564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:17.357493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a28c9-55d7-46fa-91f6-9cc1b71a3100 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:17.405646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:17.406630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:17.407165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:17.407603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:17.408666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:17.409141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:17.410753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:17.425645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bde4d-4631-403c-84fd-1a9c03930008 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:17.426210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 71/150] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:17.431979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:17.451249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:17.471625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22daaa-c371-47c0-98a8-b2fdf03e9fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:17.472722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22daaa-c371-47c0-98a8-b2fdf03e9fae None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:17.473004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22daaa-c371-47c0-98a8-b2fdf03e9fae None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:17.473278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22daaa-c371-47c0-98a8-b2fdf03e9fae None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:17.475726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22daaa-c371-47c0-98a8-b2fdf03e9fae None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:17.477355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22daaa-c371-47c0-98a8-b2fdf03e9fae None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:17.479480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 80/151] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:17 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:17.485673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22daaa-c371-47c0-98a8-b2fdf03e9fae None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:17.558597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7d23-3cbc-46b6-9e7a-f80e45e8f42b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:17.578373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:17.598234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7177a1-7fcc-421c-a137-7cb889ccfe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:17.599270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7177a1-7fcc-421c-a137-7cb889ccfe47 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:17.599557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7177a1-7fcc-421c-a137-7cb889ccfe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:17.599831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7177a1-7fcc-421c-a137-7cb889ccfe47 None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:17.601209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7177a1-7fcc-421c-a137-7cb889ccfe47 None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:17.603024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7177a1-7fcc-421c-a137-7cb889ccfe47 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:17.604804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 72/152] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:17 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:17.610967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7177a1-7fcc-421c-a137-7cb889ccfe47 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:17.621753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22daaa-c371-47c0-98a8-b2fdf03e9fae None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:17.664990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b435-5a1b-4edb-a510-77e499b44ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:17.666173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b435-5a1b-4edb-a510-77e499b44ebb None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:17.666594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b435-5a1b-4edb-a510-77e499b44ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:17.667024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12b435-5a1b-4edb-a510-77e499b44ebb None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/users/f52b946921504f2b81c190b058e18a96/roles/830a10d3893c4f1ba36a2145058dfac3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:17.670426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12b435-5a1b-4edb-a510-77e499b44ebb None admin] RBAC: Authorizing `identity:create_grant(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc, user_id=f52b946921504f2b81c190b058e18a96, role_id=830a10d3893c4f1ba36a2145058dfac3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:17.672931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12b435-5a1b-4edb-a510-77e499b44ebb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:17.694992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 81/153] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:17 2022] PUT /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/users/f52b946921504f2b81c190b058e18a96/roles/830a10d3893c4f1ba36a2145058dfac3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:03:17.721240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7177a1-7fcc-421c-a137-7cb889ccfe47 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:17.759596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1cbbe-b864-4a2b-95c7-e6738b0f133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:17.760630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1cbbe-b864-4a2b-95c7-e6738b0f133a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:17.760937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1cbbe-b864-4a2b-95c7-e6738b0f133a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:17.761248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1cbbe-b864-4a2b-95c7-e6738b0f133a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:17.825029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:17.841080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1cbbe-b864-4a2b-95c7-e6738b0f133a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:17.843154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1cbbe-b864-4a2b-95c7-e6738b0f133a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:17.968712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 73/154] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:17.974380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b435-5a1b-4edb-a510-77e499b44ebb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:18.038683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:18.100885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12b435-5a1b-4edb-a510-77e499b44ebb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:18.145348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf448df-a89e-49af-b3c3-cf981f04af8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:18.146533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448df-a89e-49af-b3c3-cf981f04af8b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:18.146987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448df-a89e-49af-b3c3-cf981f04af8b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:18.147431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf448df-a89e-49af-b3c3-cf981f04af8b None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:18.149001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf448df-a89e-49af-b3c3-cf981f04af8b None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:18.150768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf448df-a89e-49af-b3c3-cf981f04af8b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:18.152844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 82/155] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:17 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:18.159808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1cbbe-b864-4a2b-95c7-e6738b0f133a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:18.262140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:18.278252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1cbbe-b864-4a2b-95c7-e6738b0f133a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:18.315220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4857d98-3a0e-4b6d-8468-895cb5c9c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:18.316196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857d98-3a0e-4b6d-8468-895cb5c9c93f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:18.316481 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857d98-3a0e-4b6d-8468-895cb5c9c93f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:18.316756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4857d98-3a0e-4b6d-8468-895cb5c9c93f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:18.317611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4857d98-3a0e-4b6d-8468-895cb5c9c93f None admin] RBAC: Adding query filter params (role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc, user.id=73a04115ece5418abffc9b8ea0852084) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:18.317921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4857d98-3a0e-4b6d-8468-895cb5c9c93f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:18.319402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4857d98-3a0e-4b6d-8468-895cb5c9c93f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:18.327846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 74/156] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:18 2022] GET /identity/v3/role_assignments?user.id=73a04115ece5418abffc9b8ea0852084&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:19.065301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d1828-ca3a-4b1e-a27a-c8dcebd70c7d None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.066062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d1828-ca3a-4b1e-a27a-c8dcebd70c7d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.066367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d1828-ca3a-4b1e-a27a-c8dcebd70c7d None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.067705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 83/157] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:19.085805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bff3-b3f9-4d84-9d5a-1e0c3ec5bb3a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.086322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bff3-b3f9-4d84-9d5a-1e0c3ec5bb3a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.086573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0bff3-b3f9-4d84-9d5a-1e0c3ec5bb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.109764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2fe0bff3-b3f9-4d84-9d5a-1e0c3ec5bb3a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:19.110980 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2fe0bff3-b3f9-4d84-9d5a-1e0c3ec5bb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:19.200619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 75/158] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:19.225148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d1828-ca3a-4b1e-a27a-c8dcebd70c7d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:19.341592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d1828-ca3a-4b1e-a27a-c8dcebd70c7d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:19.364475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:19.379551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77c5c6-9ba8-47c9-add5-ba6efabeb5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:19.380412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77c5c6-9ba8-47c9-add5-ba6efabeb5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.380694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77c5c6-9ba8-47c9-add5-ba6efabeb5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.380966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77c5c6-9ba8-47c9-add5-ba6efabeb5a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.392440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77c5c6-9ba8-47c9-add5-ba6efabeb5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-4e77c5c6-9ba8-47c9-add5-ba6efabeb5a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:19.401285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:19.402313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:19.403136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 84/159] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:19.409604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0bff3-b3f9-4d84-9d5a-1e0c3ec5bb3a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:19.495300 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:19.515832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0bff3-b3f9-4d84-9d5a-1e0c3ec5bb3a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:19.561118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913108-fa0c-4916-9ba9-db303eea6460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:19.561942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913108-fa0c-4916-9ba9-db303eea6460 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.562226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913108-fa0c-4916-9ba9-db303eea6460 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.562502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913108-fa0c-4916-9ba9-db303eea6460 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.563262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913108-fa0c-4916-9ba9-db303eea6460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:19.563564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913108-fa0c-4916-9ba9-db303eea6460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:19.565198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913108-fa0c-4916-9ba9-db303eea6460 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:19.576079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 76/160] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:19.582258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77c5c6-9ba8-47c9-add5-ba6efabeb5a2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:19.693262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77c5c6-9ba8-47c9-add5-ba6efabeb5a2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:19.729230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b40268-d9ce-4666-9c57-4433c3dce9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:19.730119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40268-d9ce-4666-9c57-4433c3dce9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.730450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40268-d9ce-4666-9c57-4433c3dce9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.730723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b40268-d9ce-4666-9c57-4433c3dce9a6 None admin] PATH_INFO: `/v3/users/7c31e5107fca4386ab7dffdeb4815b90` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.733421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211528-5833-4939-ab84-b6eee64edf9f None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.733707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211528-5833-4939-ab84-b6eee64edf9f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.733976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd211528-5833-4939-ab84-b6eee64edf9f None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.735458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 77/161] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:19.735642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b40268-d9ce-4666-9c57-4433c3dce9a6 None admin] RBAC: Authorizing `identity:get_user(user_id=7c31e5107fca4386ab7dffdeb4815b90)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:19.737172 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b40268-d9ce-4666-9c57-4433c3dce9a6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:19.738886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 85/162] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:19 2022] GET /identity/v3/users/7c31e5107fca4386ab7dffdeb4815b90 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:19.744315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd211528-5833-4939-ab84-b6eee64edf9f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:19.756680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c7c2-bd25-477c-8931-6fde3e45b99f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.756982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c7c2-bd25-477c-8931-6fde3e45b99f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.757236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c7c2-bd25-477c-8931-6fde3e45b99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.793343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-41d7c7c2-bd25-477c-8931-6fde3e45b99f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:19.794539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-41d7c7c2-bd25-477c-8931-6fde3e45b99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:19.892685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:19.931413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 86/163] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:19.933288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee9f69-7cfc-4267-9569-19627c6f7ca0 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.933659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee9f69-7cfc-4267-9569-19627c6f7ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.934362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee9f69-7cfc-4267-9569-19627c6f7ca0 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.936915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 87/164] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:19.946220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682db92-6471-4eca-8747-bbf80048988b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:19.946752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682db92-6471-4eca-8747-bbf80048988b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:19.947182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682db92-6471-4eca-8747-bbf80048988b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:19.962065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd211528-5833-4939-ab84-b6eee64edf9f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:19.975817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2682db92-6471-4eca-8747-bbf80048988b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:19.977047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2682db92-6471-4eca-8747-bbf80048988b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:20.024845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80626a68-4443-4c7f-984c-826a713feae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:20.025496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80626a68-4443-4c7f-984c-826a713feae8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:20.025778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80626a68-4443-4c7f-984c-826a713feae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:20.026049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80626a68-4443-4c7f-984c-826a713feae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:20.061292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:20.110326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 88/165] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:20.111193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682db92-6471-4eca-8747-bbf80048988b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:20.184168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80626a68-4443-4c7f-984c-826a713feae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:20.185674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80626a68-4443-4c7f-984c-826a713feae8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:20.340159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682db92-6471-4eca-8747-bbf80048988b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:20.355478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:20.405279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 78/166] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:20.406501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80626a68-4443-4c7f-984c-826a713feae8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:20.416235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a809-9d2d-4afd-8190-673252eefc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:20.417060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a809-9d2d-4afd-8190-673252eefc32 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:20.417343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a809-9d2d-4afd-8190-673252eefc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:20.417618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a809-9d2d-4afd-8190-673252eefc32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:20.439264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6a809-9d2d-4afd-8190-673252eefc32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-60e6a809-9d2d-4afd-8190-673252eefc32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:20.456933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:20.457878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:20.458895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 89/167] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:20.459571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a809-9d2d-4afd-8190-673252eefc32 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:20.540469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:20.672906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80626a68-4443-4c7f-984c-826a713feae8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:20.711298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a17e-cc6f-4a4c-8ad9-4abb033b9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:20.712444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a17e-cc6f-4a4c-8ad9-4abb033b9beb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:20.712808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a17e-cc6f-4a4c-8ad9-4abb033b9beb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:20.713091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a17e-cc6f-4a4c-8ad9-4abb033b9beb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:20.722070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a809-9d2d-4afd-8190-673252eefc32 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:20.725400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85a17e-cc6f-4a4c-8ad9-4abb033b9beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7c85a17e-cc6f-4a4c-8ad9-4abb033b9beb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:20.734385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:20.735322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:20.736149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:20.738783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 79/168] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:20.740009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a17e-cc6f-4a4c-8ad9-4abb033b9beb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:20.828884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf7155-f8dc-4df1-82bc-d4739acc99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:20.829794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf7155-f8dc-4df1-82bc-d4739acc99bf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:20.830085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf7155-f8dc-4df1-82bc-d4739acc99bf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:20.830368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf7155-f8dc-4df1-82bc-d4739acc99bf None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:20.831679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf7155-f8dc-4df1-82bc-d4739acc99bf None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:20.833394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf7155-f8dc-4df1-82bc-d4739acc99bf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:20.835258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 90/169] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:20 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:20.836072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf7155-f8dc-4df1-82bc-d4739acc99bf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:20.908654 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:20.941312 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a17e-cc6f-4a4c-8ad9-4abb033b9beb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:20.944415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:20.977331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf7155-f8dc-4df1-82bc-d4739acc99bf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:21.013167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:21.013488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:21.013880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.014164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.014957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.015293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.015719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.015827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:21.016027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:21.016389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.017303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:21.017655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:21.017935 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:21.019484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:21.028869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 91/170] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:21.030120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:21.035653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 80/171] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:21.036597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:21.134247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:21.148562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0aec0-911c-473a-a8da-d58fe4f16722 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:21.205344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:21.206500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.207098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.207578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.208676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc, user.id=7c31e5107fca4386ab7dffdeb4815b90) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:21.209196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:21.211166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:21.225515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 92/172] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:21 2022] GET /identity/v3/role_assignments?user.id=7c31e5107fca4386ab7dffdeb4815b90&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:21.226831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:21.236950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669c3b2-f94c-45c8-9f3d-b6f251f668e6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:21.310337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa1ff3-3ec6-4eaa-b1e1-32692d9adf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:21.311632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa1ff3-3ec6-4eaa-b1e1-32692d9adf59 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.312118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa1ff3-3ec6-4eaa-b1e1-32692d9adf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.312633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa1ff3-3ec6-4eaa-b1e1-32692d9adf59 None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.314173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa1ff3-3ec6-4eaa-b1e1-32692d9adf59 None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:21.316078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa1ff3-3ec6-4eaa-b1e1-32692d9adf59 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:21.318006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 81/173] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:21 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:21.319570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3af22-0840-4931-a6f7-420c5c94fdc6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.320047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3af22-0840-4931-a6f7-420c5c94fdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.320593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3af22-0840-4931-a6f7-420c5c94fdc6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.322147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 82/174] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:21.323805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3af22-0840-4931-a6f7-420c5c94fdc6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:21.360374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:21.424556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5fb0e-f050-4727-9245-80f9ab4839f1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:21.445431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3af22-0840-4931-a6f7-420c5c94fdc6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:21.464473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43ad7d-7e4f-49a0-a7e4-fa312ee9b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:21.465641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43ad7d-7e4f-49a0-a7e4-fa312ee9b5aa None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.466075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43ad7d-7e4f-49a0-a7e4-fa312ee9b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.466501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43ad7d-7e4f-49a0-a7e4-fa312ee9b5aa None admin] PATH_INFO: `/v3/users/73a04115ece5418abffc9b8ea0852084` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.468135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43ad7d-7e4f-49a0-a7e4-fa312ee9b5aa None admin] RBAC: Authorizing `identity:get_user(user_id=73a04115ece5418abffc9b8ea0852084)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:21.469860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43ad7d-7e4f-49a0-a7e4-fa312ee9b5aa None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:21.472135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 93/175] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:21 2022] GET /identity/v3/users/73a04115ece5418abffc9b8ea0852084 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:21.477905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd3059-cc57-47f9-afff-fd2d0939f305 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.478674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd3059-cc57-47f9-afff-fd2d0939f305 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.479157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd3059-cc57-47f9-afff-fd2d0939f305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.486892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c121b-0caf-40df-a12b-1bda3ee2f457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:21.487619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c121b-0caf-40df-a12b-1bda3ee2f457 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.487991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c121b-0caf-40df-a12b-1bda3ee2f457 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.488361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c121b-0caf-40df-a12b-1bda3ee2f457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.498379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9ffd3059-cc57-47f9-afff-fd2d0939f305 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:21.500584 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9ffd3059-cc57-47f9-afff-fd2d0939f305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:21.576386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c121b-0caf-40df-a12b-1bda3ee2f457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:21.578676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c121b-0caf-40df-a12b-1bda3ee2f457 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:21.580701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:21.590665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 94/176] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:21.600827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4317c27-744d-441f-af39-363a026b41b2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.601476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4317c27-744d-441f-af39-363a026b41b2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.601958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4317c27-744d-441f-af39-363a026b41b2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.604021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 95/177] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:21.605093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4317c27-744d-441f-af39-363a026b41b2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:21.623734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:21.705426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 83/178] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:03:21.707185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8106c-0df9-40e8-a977-9e54a5ece184 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.707696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8106c-0df9-40e8-a977-9e54a5ece184 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.708203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8106c-0df9-40e8-a977-9e54a5ece184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.727534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-42a8106c-0df9-40e8-a977-9e54a5ece184 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:21.729226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-42a8106c-0df9-40e8-a977-9e54a5ece184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:21.733514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4317c27-744d-441f-af39-363a026b41b2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:21.778575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6e46-4bfa-49a9-a11d-eea59dc7056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:21.779243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6e46-4bfa-49a9-a11d-eea59dc7056b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.779520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6e46-4bfa-49a9-a11d-eea59dc7056b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.780147 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6e46-4bfa-49a9-a11d-eea59dc7056b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.813563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 84/179] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:21.814422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8106c-0df9-40e8-a977-9e54a5ece184 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:21.817999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:21.864435 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae6e46-4bfa-49a9-a11d-eea59dc7056b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:21.866324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae6e46-4bfa-49a9-a11d-eea59dc7056b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:21.888593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:21.929426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8106c-0df9-40e8-a977-9e54a5ece184 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:21.964574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15593069-538e-475e-a1ec-ca76ddbad769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:21.965380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593069-538e-475e-a1ec-ca76ddbad769 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.965763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593069-538e-475e-a1ec-ca76ddbad769 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.966043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593069-538e-475e-a1ec-ca76ddbad769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.977228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15593069-538e-475e-a1ec-ca76ddbad769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:21.979112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 96/180] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:21.979908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6e46-4bfa-49a9-a11d-eea59dc7056b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-15593069-538e-475e-a1ec-ca76ddbad769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:21.985597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:21.986617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 85/181] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:21.992440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618474d-94b1-4ac9-a0f9-a518daf3c94d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.993173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618474d-94b1-4ac9-a0f9-a518daf3c94d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.993173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618474d-94b1-4ac9-a0f9-a518daf3c94d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.993173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 86/182] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:21.993173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c075b6-6ba1-41f2-b231-12bed1bd2fcb None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:21.993173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c075b6-6ba1-41f2-b231-12bed1bd2fcb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:21.993173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c075b6-6ba1-41f2-b231-12bed1bd2fcb None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:21.995118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 87/183] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:21.996534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c075b6-6ba1-41f2-b231-12bed1bd2fcb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.043767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:22.086709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6e46-4bfa-49a9-a11d-eea59dc7056b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.103002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c075b6-6ba1-41f2-b231-12bed1bd2fcb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.121419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1b37-2b4e-4d1e-b1fb-7863e0d2d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.122289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1b37-2b4e-4d1e-b1fb-7863e0d2d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.122567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1b37-2b4e-4d1e-b1fb-7863e0d2d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.122842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b1b37-2b4e-4d1e-b1fb-7863e0d2d3b7 None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.124651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1b37-2b4e-4d1e-b1fb-7863e0d2d3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:22.126163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b1b37-2b4e-4d1e-b1fb-7863e0d2d3b7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:22.126706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:22.127910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 97/184] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:21 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:22.128730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1b37-2b4e-4d1e-b1fb-7863e0d2d3b7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.140043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301cbef-2ae8-4d40-adec-87eba9e16b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.140889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301cbef-2ae8-4d40-adec-87eba9e16b8a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.141180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301cbef-2ae8-4d40-adec-87eba9e16b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.141446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301cbef-2ae8-4d40-adec-87eba9e16b8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.151996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301cbef-2ae8-4d40-adec-87eba9e16b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5301cbef-2ae8-4d40-adec-87eba9e16b8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:22.160407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:22.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:22.162159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 88/185] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:22.162826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301cbef-2ae8-4d40-adec-87eba9e16b8a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.249771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b1b37-2b4e-4d1e-b1fb-7863e0d2d3b7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.276003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301cbef-2ae8-4d40-adec-87eba9e16b8a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.278739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:22.289709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a276ab-db6a-423e-af2c-dfef1452e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.290567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a276ab-db6a-423e-af2c-dfef1452e313 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.290936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a276ab-db6a-423e-af2c-dfef1452e313 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.291205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a276ab-db6a-423e-af2c-dfef1452e313 None admin] PATH_INFO: `/v3/projects/71b015a2b8364afe8d1c20e6d0cbb0bd` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.292438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a276ab-db6a-423e-af2c-dfef1452e313 None admin] RBAC: Authorizing `identity:get_project(project_id=71b015a2b8364afe8d1c20e6d0cbb0bd)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:22.293921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a276ab-db6a-423e-af2c-dfef1452e313 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:22.296370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 98/186] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/projects/71b015a2b8364afe8d1c20e6d0cbb0bd => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:22.297412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01185c99-91b1-4f32-bac1-307e6f66fa15 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.297694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01185c99-91b1-4f32-bac1-307e6f66fa15 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.297955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01185c99-91b1-4f32-bac1-307e6f66fa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.314639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-01185c99-91b1-4f32-bac1-307e6f66fa15 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:22.316139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-01185c99-91b1-4f32-bac1-307e6f66fa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:22.317187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de15ceb-7018-4e5b-a57e-a8086dd8e8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.317868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15ceb-7018-4e5b-a57e-a8086dd8e8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.318156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15ceb-7018-4e5b-a57e-a8086dd8e8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.318430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15ceb-7018-4e5b-a57e-a8086dd8e8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.319198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de15ceb-7018-4e5b-a57e-a8086dd8e8a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:22.319507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de15ceb-7018-4e5b-a57e-a8086dd8e8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:22.320950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de15ceb-7018-4e5b-a57e-a8086dd8e8a6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:22.329795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 89/187] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:22.331094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9a922-fc98-4c71-9f5b-e2c6b2fa4d64 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.331460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9a922-fc98-4c71-9f5b-e2c6b2fa4d64 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.331885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9a922-fc98-4c71-9f5b-e2c6b2fa4d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.354232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7cd9a922-fc98-4c71-9f5b-e2c6b2fa4d64 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:22.355459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7cd9a922-fc98-4c71-9f5b-e2c6b2fa4d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:22.390376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 99/188] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:22.391339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01185c99-91b1-4f32-bac1-307e6f66fa15 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.409721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:22.440736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 90/189] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:22.441943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9a922-fc98-4c71-9f5b-e2c6b2fa4d64 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.498581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01185c99-91b1-4f32-bac1-307e6f66fa15 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.526289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:22.541248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.541909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.542195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.542470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.543317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] RBAC: Adding query filter params (role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc, user.id=73a04115ece5418abffc9b8ea0852084) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:22.543634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:22.545245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:22.551563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 100/190] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/role_assignments?user.id=73a04115ece5418abffc9b8ea0852084&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:22.552097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9a922-fc98-4c71-9f5b-e2c6b2fa4d64 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.552405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.596905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.597590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.597875 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.598138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.598910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:22.599216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:22.600788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:22.610947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 91/191] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:22.616627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.661459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:22.683326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422929a-5eca-40c4-845b-385628cdf950 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.729899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.730856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.731309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.731759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.733015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] RBAC: Adding query filter params (role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=71b015a2b8364afe8d1c20e6d0cbb0bd, user.id=73a04115ece5418abffc9b8ea0852084) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:22.733528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:22.736093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:22.741034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f364f-961a-46f4-a92e-9f8c196f292a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.745817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 101/192] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/role_assignments?user.id=73a04115ece5418abffc9b8ea0852084&scope.project.id=71b015a2b8364afe8d1c20e6d0cbb0bd&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:22.747520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.791924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977676e9-61a0-499b-bcaa-57f72e46a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.792817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977676e9-61a0-499b-bcaa-57f72e46a28c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.793105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977676e9-61a0-499b-bcaa-57f72e46a28c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.793385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977676e9-61a0-499b-bcaa-57f72e46a28c None admin] PATH_INFO: `/v3/users/cbb0d059d0d3423988db23a74136827b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.816788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977676e9-61a0-499b-bcaa-57f72e46a28c None admin] RBAC: Authorizing `identity:get_user(user_id=cbb0d059d0d3423988db23a74136827b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:22.818748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977676e9-61a0-499b-bcaa-57f72e46a28c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:22.821677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:22.825228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 92/193] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/users/cbb0d059d0d3423988db23a74136827b => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:22.825228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977676e9-61a0-499b-bcaa-57f72e46a28c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:22.888806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fc23e-351d-4c26-97d8-56f1454f9eb5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.942816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b94e-7965-4e81-a810-97328e37756a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:22.943648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b94e-7965-4e81-a810-97328e37756a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:22.944489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b94e-7965-4e81-a810-97328e37756a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:22.944489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134b94e-7965-4e81-a810-97328e37756a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:22.950442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:22.958877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977676e9-61a0-499b-bcaa-57f72e46a28c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:22.959723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134b94e-7965-4e81-a810-97328e37756a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3134b94e-7965-4e81-a810-97328e37756a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:22.968500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:22.969550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:22.970504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:22.972554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 102/194] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:22.973643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b94e-7965-4e81-a810-97328e37756a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.002832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be01ce-be7d-4d3d-8acc-803954354ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.003648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be01ce-be7d-4d3d-8acc-803954354ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.004151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be01ce-be7d-4d3d-8acc-803954354ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.004281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be01ce-be7d-4d3d-8acc-803954354ce8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.005921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be01ce-be7d-4d3d-8acc-803954354ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.007411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be01ce-be7d-4d3d-8acc-803954354ce8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.009163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 93/195] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:23.009966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be01ce-be7d-4d3d-8acc-803954354ce8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.094614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134b94e-7965-4e81-a810-97328e37756a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.108051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:23.121228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be01ce-be7d-4d3d-8acc-803954354ce8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.131180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f43136-0ffa-4f4e-821f-7f6f67803214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.132067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f43136-0ffa-4f4e-821f-7f6f67803214 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.132383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f43136-0ffa-4f4e-821f-7f6f67803214 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.132659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f43136-0ffa-4f4e-821f-7f6f67803214 None admin] PATH_INFO: `/v3/users/f52b946921504f2b81c190b058e18a96` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.133864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f43136-0ffa-4f4e-821f-7f6f67803214 None admin] RBAC: Authorizing `identity:get_user(user_id=f52b946921504f2b81c190b058e18a96)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.135318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f43136-0ffa-4f4e-821f-7f6f67803214 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.137278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 103/196] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:22 2022] GET /identity/v3/users/f52b946921504f2b81c190b058e18a96 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:23.137762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f43136-0ffa-4f4e-821f-7f6f67803214 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.160168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82293d6c-58ec-4b19-b8f2-004e2550c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.160825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82293d6c-58ec-4b19-b8f2-004e2550c952 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.161105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82293d6c-58ec-4b19-b8f2-004e2550c952 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.161378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82293d6c-58ec-4b19-b8f2-004e2550c952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.199734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:23.244020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f43136-0ffa-4f4e-821f-7f6f67803214 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.253304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82293d6c-58ec-4b19-b8f2-004e2550c952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.255085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82293d6c-58ec-4b19-b8f2-004e2550c952 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.280930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.281849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.282276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.282559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.283680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:23.284086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.285925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.298477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 104/197] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:23.299982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.364926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:23.381559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 94/198] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:23.382509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82293d6c-58ec-4b19-b8f2-004e2550c952 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.439531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b318f0c-242c-4938-835c-7d01fc1f7f3c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.448076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:23.475144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089a12-cc0a-45a7-9ba4-19daec880ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.475815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089a12-cc0a-45a7-9ba4-19daec880ee7 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.476123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089a12-cc0a-45a7-9ba4-19daec880ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.476472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8089a12-cc0a-45a7-9ba4-19daec880ee7 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.477130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8089a12-cc0a-45a7-9ba4-19daec880ee7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.478600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8089a12-cc0a-45a7-9ba4-19daec880ee7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.494661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82293d6c-58ec-4b19-b8f2-004e2550c952 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.498475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 105/199] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:23 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:03:23.499883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089a12-cc0a-45a7-9ba4-19daec880ee7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.550448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032390-aa55-4df8-8775-b30d096fa676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.551708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032390-aa55-4df8-8775-b30d096fa676 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.551708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032390-aa55-4df8-8775-b30d096fa676 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.551908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4032390-aa55-4df8-8775-b30d096fa676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.633829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:23.638158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032390-aa55-4df8-8775-b30d096fa676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.638825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8089a12-cc0a-45a7-9ba4-19daec880ee7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.639723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4032390-aa55-4df8-8775-b30d096fa676 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.690003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d65a3e-ca7e-4104-ad13-0c91fb934ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.691765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d65a3e-ca7e-4104-ad13-0c91fb934ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.692039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d65a3e-ca7e-4104-ad13-0c91fb934ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.692625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d65a3e-ca7e-4104-ad13-0c91fb934ac7 None admin] PATH_INFO: `/v3/users/cbb0d059d0d3423988db23a74136827b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.693639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d65a3e-ca7e-4104-ad13-0c91fb934ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=cbb0d059d0d3423988db23a74136827b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.695116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d65a3e-ca7e-4104-ad13-0c91fb934ac7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.696921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 106/200] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:23 2022] GET /identity/v3/users/cbb0d059d0d3423988db23a74136827b => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:23.697714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d65a3e-ca7e-4104-ad13-0c91fb934ac7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.718392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:23.772181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 95/201] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:23.772889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032390-aa55-4df8-8775-b30d096fa676 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.848563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d65a3e-ca7e-4104-ad13-0c91fb934ac7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.889046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642bb9d-142e-4351-a372-5cb55f08c405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.890838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642bb9d-142e-4351-a372-5cb55f08c405 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.891224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642bb9d-142e-4351-a372-5cb55f08c405 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.891600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642bb9d-142e-4351-a372-5cb55f08c405 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:23.893130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642bb9d-142e-4351-a372-5cb55f08c405 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:23.894724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642bb9d-142e-4351-a372-5cb55f08c405 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:23.897028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 107/202] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:23 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:23.897990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642bb9d-142e-4351-a372-5cb55f08c405 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:23.922616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4032390-aa55-4df8-8775-b30d096fa676 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:23.941195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:23.967969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0295ef-ef24-45e7-ba35-7a64771c9ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:23.968619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0295ef-ef24-45e7-ba35-7a64771c9ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:23.968973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0295ef-ef24-45e7-ba35-7a64771c9ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:23.969338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0295ef-ef24-45e7-ba35-7a64771c9ea3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:24.005924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:24.016928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642bb9d-142e-4351-a372-5cb55f08c405 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:24.056637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578978f-c226-41c6-8f03-f0cdb2e0aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:24.057686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578978f-c226-41c6-8f03-f0cdb2e0aa76 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:24.058103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578978f-c226-41c6-8f03-f0cdb2e0aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:24.058417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578978f-c226-41c6-8f03-f0cdb2e0aa76 None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:24.059856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578978f-c226-41c6-8f03-f0cdb2e0aa76 None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:24.062034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578978f-c226-41c6-8f03-f0cdb2e0aa76 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:24.063931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 108/203] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:23 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:24.064878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578978f-c226-41c6-8f03-f0cdb2e0aa76 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:24.065520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0295ef-ef24-45e7-ba35-7a64771c9ea3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:24.067483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0295ef-ef24-45e7-ba35-7a64771c9ea3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:24.184205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578978f-c226-41c6-8f03-f0cdb2e0aa76 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:24.186309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:24.197653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 96/204] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:24.198856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0295ef-ef24-45e7-ba35-7a64771c9ea3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:24.251917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:24.252942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:24.253518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:24.254087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:24.255672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb, user.id=cbb0d059d0d3423988db23a74136827b) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:24.256337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:24.258421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:24.272573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 109/205] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:24 2022] GET /identity/v3/role_assignments?user.id=cbb0d059d0d3423988db23a74136827b&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:24.272573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:24.306765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:24.401098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0295ef-ef24-45e7-ba35-7a64771c9ea3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:24.481601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:24.482199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:24.482485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:24.482761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:24.484501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] RBAC: Adding query filter params (role.id=830a10d3893c4f1ba36a2145058dfac3, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc, user.id=f52b946921504f2b81c190b058e18a96) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:24.484816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:24.490620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:24.498119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bba501-c00e-45aa-8d3b-d602289527ea None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:24.502056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 97/206] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:24 2022] GET /identity/v3/role_assignments?user.id=f52b946921504f2b81c190b058e18a96&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=830a10d3893c4f1ba36a2145058dfac3 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:24.542892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3b93-021d-4e2a-b693-177acf832526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:24.543791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3b93-021d-4e2a-b693-177acf832526 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:24.544072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3b93-021d-4e2a-b693-177acf832526 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:24.544378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3b93-021d-4e2a-b693-177acf832526 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:24.546305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3b93-021d-4e2a-b693-177acf832526 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:24.547983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3b93-021d-4e2a-b693-177acf832526 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:24.550222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 110/207] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:24 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:24.556322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:24.703264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3006e54-216c-4ab2-abb1-fe7523cdefb5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:24.740596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:24.753048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115d9b-54b4-4349-988d-8cd01cee3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:24.754057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115d9b-54b4-4349-988d-8cd01cee3d81 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:24.754444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115d9b-54b4-4349-988d-8cd01cee3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:24.754723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115d9b-54b4-4349-988d-8cd01cee3d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:24.755594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115d9b-54b4-4349-988d-8cd01cee3d81 None admin] RBAC: Adding query filter params (role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb, user.id=cbb0d059d0d3423988db23a74136827b) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:24.755899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115d9b-54b4-4349-988d-8cd01cee3d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:24.757451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115d9b-54b4-4349-988d-8cd01cee3d81 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:24.764225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 98/208] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:24 2022] GET /identity/v3/role_assignments?user.id=cbb0d059d0d3423988db23a74136827b&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:25.797973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa955d-b382-4c89-89ed-a91a19adfd31 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:25.798455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa955d-b382-4c89-89ed-a91a19adfd31 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:25.798455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa955d-b382-4c89-89ed-a91a19adfd31 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:25.799949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 111/209] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:25.805489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782552cf-d73e-4e80-a9f2-7041eff9a171 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:25.806323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782552cf-d73e-4e80-a9f2-7041eff9a171 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:25.806830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782552cf-d73e-4e80-a9f2-7041eff9a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:25.824804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-782552cf-d73e-4e80-a9f2-7041eff9a171 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:25.826318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-782552cf-d73e-4e80-a9f2-7041eff9a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:25.902741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 99/210] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:25.927334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa955d-b382-4c89-89ed-a91a19adfd31 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:25.965489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c38d-0d5f-431b-abee-1bb0c6a4ad84 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:25.965796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c38d-0d5f-431b-abee-1bb0c6a4ad84 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:25.966064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c38d-0d5f-431b-abee-1bb0c6a4ad84 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:25.968334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 100/211] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:25.970368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:25.976064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da877ec2-4b23-4c03-bf51-02a55b3bc444 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:25.976716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da877ec2-4b23-4c03-bf51-02a55b3bc444 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:25.977192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da877ec2-4b23-4c03-bf51-02a55b3bc444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:25.996461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-da877ec2-4b23-4c03-bf51-02a55b3bc444 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:25.998067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-da877ec2-4b23-4c03-bf51-02a55b3bc444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:26.045402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa955d-b382-4c89-89ed-a91a19adfd31 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:26.082135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 101/212] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:26.089753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214736-7a6d-490f-8666-eed9f7b5dcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:26.090791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214736-7a6d-490f-8666-eed9f7b5dcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:26.091275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214736-7a6d-490f-8666-eed9f7b5dcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:26.091774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81214736-7a6d-490f-8666-eed9f7b5dcb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:26.103658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81214736-7a6d-490f-8666-eed9f7b5dcb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:26.107759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da877ec2-4b23-4c03-bf51-02a55b3bc444 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-81214736-7a6d-490f-8666-eed9f7b5dcb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:26.114442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:26.115369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:26.116197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:26.119000 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 112/213] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:26.125370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214736-7a6d-490f-8666-eed9f7b5dcb2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:26.163240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:26.232990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da877ec2-4b23-4c03-bf51-02a55b3bc444 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:26.246081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:26.257231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81214736-7a6d-490f-8666-eed9f7b5dcb2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:26.279521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cfc82-4437-4740-b335-76bd62770641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:26.281006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfc82-4437-4740-b335-76bd62770641 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:26.281290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfc82-4437-4740-b335-76bd62770641 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:26.281564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfc82-4437-4740-b335-76bd62770641 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:26.282773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cfc82-4437-4740-b335-76bd62770641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:26.284277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cfc82-4437-4740-b335-76bd62770641 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:26.285932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 102/214] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:26.291372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cfc82-4437-4740-b335-76bd62770641 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:26.298984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:26.299654 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:26.299939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:26.300253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:26.301023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:26.301326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:26.302816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:26.311840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 113/215] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:26.317680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:26.399140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cfc82-4437-4740-b335-76bd62770641 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:26.418041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:26.427322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fbb8e-1b4d-42f6-b938-47a10abc77c0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:26.438108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957038-ee9a-4e49-849a-a8365c24a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:26.439047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957038-ee9a-4e49-849a-a8365c24a977 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:26.439475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957038-ee9a-4e49-849a-a8365c24a977 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:26.439897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78957038-ee9a-4e49-849a-a8365c24a977 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:26.441131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78957038-ee9a-4e49-849a-a8365c24a977 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:26.442728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78957038-ee9a-4e49-849a-a8365c24a977 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:26.465126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ea798-8d37-4ae7-9746-bdca64f4d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:26.466062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ea798-8d37-4ae7-9746-bdca64f4d2dd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:26.466343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ea798-8d37-4ae7-9746-bdca64f4d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:26.466611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ea798-8d37-4ae7-9746-bdca64f4d2dd None admin] PATH_INFO: `/v3/users/49ee7e03b1014e92b149d6890a683008` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:26.466917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 103/216] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:26 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:03:26.483750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ea798-8d37-4ae7-9746-bdca64f4d2dd None admin] RBAC: Authorizing `identity:get_user(user_id=49ee7e03b1014e92b149d6890a683008)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:26.485394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ea798-8d37-4ae7-9746-bdca64f4d2dd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:26.487587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 114/217] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:26 2022] GET /identity/v3/users/49ee7e03b1014e92b149d6890a683008 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:26.493288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957038-ee9a-4e49-849a-a8365c24a977 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:26.634298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78957038-ee9a-4e49-849a-a8365c24a977 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:26.665596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1997ca8-4cec-4fbc-80f6-ec80753f52fc None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:26.665831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1997ca8-4cec-4fbc-80f6-ec80753f52fc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:26.666082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1997ca8-4cec-4fbc-80f6-ec80753f52fc None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:26.667457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 115/218] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:26.677827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c645d3-aae8-4bd6-9ab7-6b129bad5f9c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:26.678105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c645d3-aae8-4bd6-9ab7-6b129bad5f9c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:26.678482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c645d3-aae8-4bd6-9ab7-6b129bad5f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:26.678918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca06b96-9921-49c6-96cb-08eb597d8a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:26.679571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca06b96-9921-49c6-96cb-08eb597d8a6a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:26.679868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca06b96-9921-49c6-96cb-08eb597d8a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:26.680219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca06b96-9921-49c6-96cb-08eb597d8a6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:26.698140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a0c645d3-aae8-4bd6-9ab7-6b129bad5f9c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:26.699342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a0c645d3-aae8-4bd6-9ab7-6b129bad5f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:26.711784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:26.747031 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:26.784004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca06b96-9921-49c6-96cb-08eb597d8a6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:26.786170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca06b96-9921-49c6-96cb-08eb597d8a6a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:26.798719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 116/219] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:26.825260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c645d3-aae8-4bd6-9ab7-6b129bad5f9c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:26.896744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 104/220] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:26.902381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca06b96-9921-49c6-96cb-08eb597d8a6a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:26.962487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c645d3-aae8-4bd6-9ab7-6b129bad5f9c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.007218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4492ac-05f4-4ca0-a09e-c74932cbe482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.008035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4492ac-05f4-4ca0-a09e-c74932cbe482 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4492ac-05f4-4ca0-a09e-c74932cbe482 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.008488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:27.008639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4492ac-05f4-4ca0-a09e-c74932cbe482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.024542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4492ac-05f4-4ca0-a09e-c74932cbe482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-fa4492ac-05f4-4ca0-a09e-c74932cbe482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:27.035781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:27.036944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:27.037933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 117/221] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:27.038688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7519-bb5a-494d-b65e-e18ec7c2b650 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.038688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7519-bb5a-494d-b65e-e18ec7c2b650 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.039112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f7519-bb5a-494d-b65e-e18ec7c2b650 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.039926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca06b96-9921-49c6-96cb-08eb597d8a6a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.040389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 118/222] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:27.047055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f7519-bb5a-494d-b65e-e18ec7c2b650 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:27.050958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:27.087864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb56d5-3ab0-4a4f-ba50-c3a773f4f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.089032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb56d5-3ab0-4a4f-ba50-c3a773f4f43c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.089750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb56d5-3ab0-4a4f-ba50-c3a773f4f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.090039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb56d5-3ab0-4a4f-ba50-c3a773f4f43c None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.091604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb56d5-3ab0-4a4f-ba50-c3a773f4f43c None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:27.093566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb56d5-3ab0-4a4f-ba50-c3a773f4f43c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:27.096559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 105/223] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:26 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:27.098953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f569f8-e1df-4859-9d51-9bf28fbf3809 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.100455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f569f8-e1df-4859-9d51-9bf28fbf3809 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.101547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f569f8-e1df-4859-9d51-9bf28fbf3809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.126503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a5f569f8-e1df-4859-9d51-9bf28fbf3809 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:27.128509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a5f569f8-e1df-4859-9d51-9bf28fbf3809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:27.174786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f7519-bb5a-494d-b65e-e18ec7c2b650 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.221122 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 106/224] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:27.222360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f569f8-e1df-4859-9d51-9bf28fbf3809 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:27.228760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.230477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.231127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.231579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.237345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:27.237844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:27.239900 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:27.253919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 119/225] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:27.255295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:27.324639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:27.355168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:27.357641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f569f8-e1df-4859-9d51-9bf28fbf3809 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.399356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.400019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.400321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.400597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.401438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] RBAC: Adding query filter params (role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb, user.id=49ee7e03b1014e92b149d6890a683008) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:27.401748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:27.403222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:27.409766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 107/226] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:27 2022] GET /identity/v3/role_assignments?user.id=49ee7e03b1014e92b149d6890a683008&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:27.410633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:27.415096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4b355-c6dd-4550-bf13-2c8d570dbc79 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.466542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c1c2-42ef-486a-ab84-fc635cdb8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.468747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c1c2-42ef-486a-ab84-fc635cdb8e19 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.469259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c1c2-42ef-486a-ab84-fc635cdb8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.469792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c1c2-42ef-486a-ab84-fc635cdb8e19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.487480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1c1c2-42ef-486a-ab84-fc635cdb8e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-e0d1c1c2-42ef-486a-ab84-fc635cdb8e19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:27.496128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:27.497125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:27.499360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 120/227] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:27.503374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c1c2-42ef-486a-ab84-fc635cdb8e19 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:27.538493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdfa7c-d284-4800-93e1-10142d65218b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.576750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816c59-fd89-4428-87ae-53b77f66b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.577713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816c59-fd89-4428-87ae-53b77f66b5dc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.577997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816c59-fd89-4428-87ae-53b77f66b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.578274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a816c59-fd89-4428-87ae-53b77f66b5dc None admin] PATH_INFO: `/v3/users/cbb0d059d0d3423988db23a74136827b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.579903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a816c59-fd89-4428-87ae-53b77f66b5dc None admin] RBAC: Authorizing `identity:get_user(user_id=cbb0d059d0d3423988db23a74136827b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:27.581361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a816c59-fd89-4428-87ae-53b77f66b5dc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:27.583253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 108/228] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:27 2022] GET /identity/v3/users/cbb0d059d0d3423988db23a74136827b => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:27.589056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816c59-fd89-4428-87ae-53b77f66b5dc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:27.593891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:27.669456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c1c2-42ef-486a-ab84-fc635cdb8e19 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.699751 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:27.706183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a816c59-fd89-4428-87ae-53b77f66b5dc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.711409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.712092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.712416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.712700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.713464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:27.713776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:27.715175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:27.731717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 121/229] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:27.739872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:27.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd203ecd-f412-4aa0-b463-1fdc326c2e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.746821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203ecd-f412-4aa0-b463-1fdc326c2e23 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.747113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203ecd-f412-4aa0-b463-1fdc326c2e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.747393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd203ecd-f412-4aa0-b463-1fdc326c2e23 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.749160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd203ecd-f412-4aa0-b463-1fdc326c2e23 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:27.750639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd203ecd-f412-4aa0-b463-1fdc326c2e23 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:27.752808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 109/230] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:27 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:27.758392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd203ecd-f412-4aa0-b463-1fdc326c2e23 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:27.852517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:27.866046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd203ecd-f412-4aa0-b463-1fdc326c2e23 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:27.903076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df062270-46f8-40d6-ae3c-fee6446dc5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:27.903990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062270-46f8-40d6-ae3c-fee6446dc5f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:27.904397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062270-46f8-40d6-ae3c-fee6446dc5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:27.904684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df062270-46f8-40d6-ae3c-fee6446dc5f4 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/users/cbb0d059d0d3423988db23a74136827b/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:27.906878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df062270-46f8-40d6-ae3c-fee6446dc5f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6560cdd2158e448ea29d06c8dc4e7ddb, user_id=cbb0d059d0d3423988db23a74136827b, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:27.908759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df062270-46f8-40d6-ae3c-fee6446dc5f4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:27.925116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 110/231] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:27 2022] PUT /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/users/cbb0d059d0d3423988db23a74136827b/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:03:27.957351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eece2-13b3-4700-b83e-10bff0d8bf1b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:28.023646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271250-4ec3-4f8b-84f8-fd2abb337af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:28.024886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271250-4ec3-4f8b-84f8-fd2abb337af4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:28.025177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271250-4ec3-4f8b-84f8-fd2abb337af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:28.025452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271250-4ec3-4f8b-84f8-fd2abb337af4 None admin] PATH_INFO: `/v3/users/cbb0d059d0d3423988db23a74136827b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:28.027742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e271250-4ec3-4f8b-84f8-fd2abb337af4 None admin] RBAC: Authorizing `identity:get_user(user_id=cbb0d059d0d3423988db23a74136827b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:28.029277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e271250-4ec3-4f8b-84f8-fd2abb337af4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:28.031433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 122/232] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:27 2022] GET /identity/v3/users/cbb0d059d0d3423988db23a74136827b => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:28.037125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df062270-46f8-40d6-ae3c-fee6446dc5f4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:28.159189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df062270-46f8-40d6-ae3c-fee6446dc5f4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:28.192530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:28.198475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a9610-dc3d-42bd-a826-a118e69bf8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:28.199564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9610-dc3d-42bd-a826-a118e69bf8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:28.200330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9610-dc3d-42bd-a826-a118e69bf8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:28.200617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a9610-dc3d-42bd-a826-a118e69bf8e3 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:28.202077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a9610-dc3d-42bd-a826-a118e69bf8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:28.203881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a9610-dc3d-42bd-a826-a118e69bf8e3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:28.206224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 111/233] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:28 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:28.212123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271250-4ec3-4f8b-84f8-fd2abb337af4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:28.287116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:28.344592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e271250-4ec3-4f8b-84f8-fd2abb337af4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:28.379722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d09f50-4cbf-4622-a298-823a883089eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:28.380692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09f50-4cbf-4622-a298-823a883089eb None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:28.380983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09f50-4cbf-4622-a298-823a883089eb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:28.381264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d09f50-4cbf-4622-a298-823a883089eb None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/users/cbb0d059d0d3423988db23a74136827b/roles/9189b2de997c4913bc3d3b88754b8966` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:28.383509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d09f50-4cbf-4622-a298-823a883089eb None admin] RBAC: Authorizing `identity:create_grant(project_id=6560cdd2158e448ea29d06c8dc4e7ddb, user_id=cbb0d059d0d3423988db23a74136827b, role_id=9189b2de997c4913bc3d3b88754b8966)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:28.385100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d09f50-4cbf-4622-a298-823a883089eb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:28.404288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 123/234] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:28 2022] PUT /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/users/cbb0d059d0d3423988db23a74136827b/roles/9189b2de997c4913bc3d3b88754b8966 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:29.158793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247842-13f2-420f-9fda-745adf0ccb9a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:29.159314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247842-13f2-420f-9fda-745adf0ccb9a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:29.159410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247842-13f2-420f-9fda-745adf0ccb9a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:29.161151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 112/235] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:29.166817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980447c5-280d-4a6e-8d97-841a6bedd39e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:29.167303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980447c5-280d-4a6e-8d97-841a6bedd39e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:29.167490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980447c5-280d-4a6e-8d97-841a6bedd39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:29.197153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-980447c5-280d-4a6e-8d97-841a6bedd39e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:29.198372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-980447c5-280d-4a6e-8d97-841a6bedd39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:29.210745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5941-61ad-4953-a85d-c487e90b55ff None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:29.211383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5941-61ad-4953-a85d-c487e90b55ff None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:29.211852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea5941-61ad-4953-a85d-c487e90b55ff None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:29.213727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 113/236] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:29.219162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42263f13-cbd5-46ee-a032-a9c0417334af None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:29.219725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42263f13-cbd5-46ee-a032-a9c0417334af None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:29.220294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42263f13-cbd5-46ee-a032-a9c0417334af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:29.245183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-42263f13-cbd5-46ee-a032-a9c0417334af None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:29.247455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-42263f13-cbd5-46ee-a032-a9c0417334af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:29.301770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 124/237] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:29.329930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980447c5-280d-4a6e-8d97-841a6bedd39e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:29.382880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 114/238] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:29.403825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:29.460676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42263f13-cbd5-46ee-a032-a9c0417334af None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:29.498008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980447c5-280d-4a6e-8d97-841a6bedd39e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:29.561112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3848c-315f-484a-8f02-a8060962c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:29.561946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3848c-315f-484a-8f02-a8060962c25f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:29.562235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3848c-315f-484a-8f02-a8060962c25f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:29.562506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3848c-315f-484a-8f02-a8060962c25f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:29.574708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3848c-315f-484a-8f02-a8060962c25f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-38a3848c-315f-484a-8f02-a8060962c25f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:29.583185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:29.584149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:29.584954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 125/239] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:29.591756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3848c-315f-484a-8f02-a8060962c25f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:29.702499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3848c-315f-484a-8f02-a8060962c25f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:29.716577 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:29.743252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42263f13-cbd5-46ee-a032-a9c0417334af None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:29.773602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:29.774691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:29.775193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:29.775672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:29.776718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:29.777242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:29.778896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:29.799412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 126/240] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:29.805151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:29.816513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:29.827841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfeae2-f81f-44ff-b4fe-a1cab547a742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:29.828704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfeae2-f81f-44ff-b4fe-a1cab547a742 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:29.828991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfeae2-f81f-44ff-b4fe-a1cab547a742 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:29.829270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfeae2-f81f-44ff-b4fe-a1cab547a742 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:29.830675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfeae2-f81f-44ff-b4fe-a1cab547a742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:29.833672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfeae2-f81f-44ff-b4fe-a1cab547a742 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:29.838099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 115/241] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:29.845199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfeae2-f81f-44ff-b4fe-a1cab547a742 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:29.963181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69772-ea26-4b71-a0d5-011ffc2821a9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:30.032387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c85d-f4ec-4789-8e52-77bfda592d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:30.034604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c85d-f4ec-4789-8e52-77bfda592d3b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.036524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c85d-f4ec-4789-8e52-77bfda592d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.037006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c85d-f4ec-4789-8e52-77bfda592d3b None admin] PATH_INFO: `/v3/users/5b8579a291524a50bb52eb07fc6a2020` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.043113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfeae2-f81f-44ff-b4fe-a1cab547a742 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:30.057661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3c85d-f4ec-4789-8e52-77bfda592d3b None admin] RBAC: Authorizing `identity:get_user(user_id=5b8579a291524a50bb52eb07fc6a2020)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:30.059646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3c85d-f4ec-4789-8e52-77bfda592d3b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:30.062805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 127/242] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:29 2022] GET /identity/v3/users/5b8579a291524a50bb52eb07fc6a2020 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:30.073543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c85d-f4ec-4789-8e52-77bfda592d3b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:30.096789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8339dd1-4463-464f-9989-e5a1ccdc1336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:30.097480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339dd1-4463-464f-9989-e5a1ccdc1336 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.097766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339dd1-4463-464f-9989-e5a1ccdc1336 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.098044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8339dd1-4463-464f-9989-e5a1ccdc1336 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.099016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8339dd1-4463-464f-9989-e5a1ccdc1336 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:30.100512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8339dd1-4463-464f-9989-e5a1ccdc1336 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:30.122865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:30.143963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 116/243] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:29 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:03:30.163213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a8d9b-652e-43e2-ac3f-a6c45491994c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.163807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a8d9b-652e-43e2-ac3f-a6c45491994c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.163807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a8d9b-652e-43e2-ac3f-a6c45491994c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.165204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 117/244] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:30.171236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699223-cddb-4b76-aa6b-90eda03fccfc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.171562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699223-cddb-4b76-aa6b-90eda03fccfc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.172026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a699223-cddb-4b76-aa6b-90eda03fccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.195082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2a699223-cddb-4b76-aa6b-90eda03fccfc None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:30.196396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2a699223-cddb-4b76-aa6b-90eda03fccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:30.247238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c85d-f4ec-4789-8e52-77bfda592d3b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:30.267876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:30.290550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 118/245] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:30.324700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f4f8b-578d-48fa-b104-319012c81220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:30.325658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f4f8b-578d-48fa-b104-319012c81220 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.326085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f4f8b-578d-48fa-b104-319012c81220 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.326810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f4f8b-578d-48fa-b104-319012c81220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.331051 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a699223-cddb-4b76-aa6b-90eda03fccfc None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:30.421453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f4f8b-578d-48fa-b104-319012c81220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:30.423342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f4f8b-578d-48fa-b104-319012c81220 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:30.457410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:30.468359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a699223-cddb-4b76-aa6b-90eda03fccfc None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:30.524851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26e788-85af-4a65-b2d2-773af3ff71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:30.527660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26e788-85af-4a65-b2d2-773af3ff71b0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.528260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26e788-85af-4a65-b2d2-773af3ff71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.528733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26e788-85af-4a65-b2d2-773af3ff71b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.553120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26e788-85af-4a65-b2d2-773af3ff71b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1d26e788-85af-4a65-b2d2-773af3ff71b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:30.568705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:30.569705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:30.570538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 119/246] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:30.575652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 128/247] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:30.579828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26e788-85af-4a65-b2d2-773af3ff71b0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:30.581996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f4f8b-578d-48fa-b104-319012c81220 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:30.641711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:30.726134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26e788-85af-4a65-b2d2-773af3ff71b0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:30.728763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f4f8b-578d-48fa-b104-319012c81220 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:30.762765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:30.775096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449936-a04b-4c08-aad7-71c933e4e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:30.776081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449936-a04b-4c08-aad7-71c933e4e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.776255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef24b74-2743-4de6-a4f7-d830d0e2635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:30.776678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449936-a04b-4c08-aad7-71c933e4e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.777092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24b74-2743-4de6-a4f7-d830d0e2635b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.777340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449936-a04b-4c08-aad7-71c933e4e3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.777449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24b74-2743-4de6-a4f7-d830d0e2635b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.777640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24b74-2743-4de6-a4f7-d830d0e2635b None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.778550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449936-a04b-4c08-aad7-71c933e4e3c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:30.778888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef24b74-2743-4de6-a4f7-d830d0e2635b None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:30.779167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449936-a04b-4c08-aad7-71c933e4e3c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:30.780932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef24b74-2743-4de6-a4f7-d830d0e2635b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:30.781465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06449936-a04b-4c08-aad7-71c933e4e3c5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:30.783002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 129/248] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:30 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:30.784378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25cd4-74e6-42e2-ba27-9d4884959c14 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.785516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25cd4-74e6-42e2-ba27-9d4884959c14 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.785516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25cd4-74e6-42e2-ba27-9d4884959c14 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.790382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 130/249] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:30.790382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25cd4-74e6-42e2-ba27-9d4884959c14 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:30.798634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 120/250] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:30.800229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3fe3-db99-4949-8390-02200718057d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.800673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3fe3-db99-4949-8390-02200718057d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.801100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3fe3-db99-4949-8390-02200718057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.822748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f96b3fe3-db99-4949-8390-02200718057d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:30.824209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f96b3fe3-db99-4949-8390-02200718057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:30.906416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 121/251] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:30.907323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b3fe3-db99-4949-8390-02200718057d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:30.913470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25cd4-74e6-42e2-ba27-9d4884959c14 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:30.950326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:30.968381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf55cc-4eaf-4576-8cb1-9938f3a8ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:30.969112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf55cc-4eaf-4576-8cb1-9938f3a8ca42 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.969406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf55cc-4eaf-4576-8cb1-9938f3a8ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.969682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf55cc-4eaf-4576-8cb1-9938f3a8ca42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.970539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf55cc-4eaf-4576-8cb1-9938f3a8ca42 None admin] RBAC: Adding query filter params (role.id=830a10d3893c4f1ba36a2145058dfac3, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb, user.id=5b8579a291524a50bb52eb07fc6a2020) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:30.970859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf55cc-4eaf-4576-8cb1-9938f3a8ca42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:30.973898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf55cc-4eaf-4576-8cb1-9938f3a8ca42 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:30.987294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 131/252] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:30 2022] GET /identity/v3/role_assignments?user.id=5b8579a291524a50bb52eb07fc6a2020&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=830a10d3893c4f1ba36a2145058dfac3 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:30.988862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f19e-2534-49b5-8e20-21e3271a9ee2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:30.989168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f19e-2534-49b5-8e20-21e3271a9ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:30.989521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4f19e-2534-49b5-8e20-21e3271a9ee2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:30.991162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 132/253] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:30.992261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4f19e-2534-49b5-8e20-21e3271a9ee2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:31.068880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:31.122395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4f19e-2534-49b5-8e20-21e3271a9ee2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:31.138166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b3fe3-db99-4949-8390-02200718057d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:31.164443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abe2a2-40a8-422b-803a-81e04d74a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:31.165267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe2a2-40a8-422b-803a-81e04d74a65c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:31.165545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe2a2-40a8-422b-803a-81e04d74a65c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:31.165814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abe2a2-40a8-422b-803a-81e04d74a65c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:31.180608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abe2a2-40a8-422b-803a-81e04d74a65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-64abe2a2-40a8-422b-803a-81e04d74a65c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:31.188789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:31.189761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:31.191260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 133/254] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:31.191934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aee50d-9e03-4e8e-8cad-94ab6b3f06b0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:31.191934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aee50d-9e03-4e8e-8cad-94ab6b3f06b0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:31.192341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aee50d-9e03-4e8e-8cad-94ab6b3f06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:31.216886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-53aee50d-9e03-4e8e-8cad-94ab6b3f06b0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:31.217373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2672a-5dd6-4f7d-a3e2-163e29d6e30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:31.218781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2672a-5dd6-4f7d-a3e2-163e29d6e30c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:31.218885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-53aee50d-9e03-4e8e-8cad-94ab6b3f06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:31.219088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2672a-5dd6-4f7d-a3e2-163e29d6e30c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:31.219332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2672a-5dd6-4f7d-a3e2-163e29d6e30c None admin] PATH_INFO: `/v3/users/49ee7e03b1014e92b149d6890a683008` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:31.220632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2672a-5dd6-4f7d-a3e2-163e29d6e30c None admin] RBAC: Authorizing `identity:get_user(user_id=49ee7e03b1014e92b149d6890a683008)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:31.223489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2672a-5dd6-4f7d-a3e2-163e29d6e30c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:31.227140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 122/255] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:30 2022] GET /identity/v3/users/49ee7e03b1014e92b149d6890a683008 => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:31.228669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2672a-5dd6-4f7d-a3e2-163e29d6e30c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:31.329971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 134/256] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:31.331028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aee50d-9e03-4e8e-8cad-94ab6b3f06b0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:31.373483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2672a-5dd6-4f7d-a3e2-163e29d6e30c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:31.379037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:31.430562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:31.431248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:31.431529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:31.431806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:31.432603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:31.432910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:31.437402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:31.443313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:31.460135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 123/257] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:31.461019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:31.564353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aee50d-9e03-4e8e-8cad-94ab6b3f06b0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:31.624547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95814c-c818-45a9-99c7-d564af27ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:31.625344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95814c-c818-45a9-99c7-d564af27ca30 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:31.625628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95814c-c818-45a9-99c7-d564af27ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:31.625904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95814c-c818-45a9-99c7-d564af27ca30 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:31.627113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95814c-c818-45a9-99c7-d564af27ca30 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:31.631152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95814c-c818-45a9-99c7-d564af27ca30 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:31.634288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 135/258] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:31 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:31.634875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95814c-c818-45a9-99c7-d564af27ca30 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:31.660588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863d49b-074e-4c21-ba58-1e515b7a5821 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:31.713730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51b5c9-19a0-4b4e-9b63-9df93a1cbe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:31.714564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51b5c9-19a0-4b4e-9b63-9df93a1cbe36 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:31.714845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51b5c9-19a0-4b4e-9b63-9df93a1cbe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:31.715115 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51b5c9-19a0-4b4e-9b63-9df93a1cbe36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:31.736345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51b5c9-19a0-4b4e-9b63-9df93a1cbe36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0c51b5c9-19a0-4b4e-9b63-9df93a1cbe36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:31.744756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:31.745666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 124/259] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:31.747313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51b5c9-19a0-4b4e-9b63-9df93a1cbe36 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:31.772510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95814c-c818-45a9-99c7-d564af27ca30 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:31.790302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:31.804769 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:31.841517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15db1ba-99ad-4dfa-8a32-3e3b59a6d4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:31.842976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15db1ba-99ad-4dfa-8a32-3e3b59a6d4cd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:31.843264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15db1ba-99ad-4dfa-8a32-3e3b59a6d4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:31.843541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15db1ba-99ad-4dfa-8a32-3e3b59a6d4cd None admin] PATH_INFO: `/v3/users/cbb0d059d0d3423988db23a74136827b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:31.848968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15db1ba-99ad-4dfa-8a32-3e3b59a6d4cd None admin] RBAC: Authorizing `identity:get_user(user_id=cbb0d059d0d3423988db23a74136827b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:31.850482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15db1ba-99ad-4dfa-8a32-3e3b59a6d4cd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:31.852461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 136/260] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:31 2022] GET /identity/v3/users/cbb0d059d0d3423988db23a74136827b => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:31.853102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15db1ba-99ad-4dfa-8a32-3e3b59a6d4cd None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:31.919045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51b5c9-19a0-4b4e-9b63-9df93a1cbe36 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:31.992144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dca51-6b1c-4772-958f-c35a97a1e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:31.994996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dca51-6b1c-4772-958f-c35a97a1e250 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:31.995526 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dca51-6b1c-4772-958f-c35a97a1e250 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:31.997126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dca51-6b1c-4772-958f-c35a97a1e250 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/users/49ee7e03b1014e92b149d6890a683008/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:32.003187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dca51-6b1c-4772-958f-c35a97a1e250 None admin] RBAC: Authorizing `identity:create_grant(project_id=6560cdd2158e448ea29d06c8dc4e7ddb, user_id=49ee7e03b1014e92b149d6890a683008, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:32.007373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dca51-6b1c-4772-958f-c35a97a1e250 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:32.033365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 125/261] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:31 2022] PUT /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/users/49ee7e03b1014e92b149d6890a683008/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:32.034537 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dca51-6b1c-4772-958f-c35a97a1e250 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:32.077894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15db1ba-99ad-4dfa-8a32-3e3b59a6d4cd None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:32.117672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:32.118797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:32.119295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:32.119763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:32.120746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:32.121341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:32.122950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:32.133247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 137/262] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:32.142062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:32.202036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:32.225947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:32.271111 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e636e-8060-4fe7-840f-566bdc1e70e1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:32.286170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dca51-6b1c-4772-958f-c35a97a1e250 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:32.313818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9c15f-9f5f-4500-8279-4008ae187dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:32.315045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9c15f-9f5f-4500-8279-4008ae187dcf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:32.315522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9c15f-9f5f-4500-8279-4008ae187dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:32.316301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9c15f-9f5f-4500-8279-4008ae187dcf None admin] PATH_INFO: `/v3/users/cbb0d059d0d3423988db23a74136827b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:32.318721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9c15f-9f5f-4500-8279-4008ae187dcf None admin] RBAC: Authorizing `identity:get_user(user_id=cbb0d059d0d3423988db23a74136827b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:32.320496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9c15f-9f5f-4500-8279-4008ae187dcf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:32.322728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 138/263] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:32 2022] GET /identity/v3/users/cbb0d059d0d3423988db23a74136827b => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:32.330893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9c15f-9f5f-4500-8279-4008ae187dcf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:32.376839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58987077-9fd8-4e4f-9b35-94ef2f29379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:32.377553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58987077-9fd8-4e4f-9b35-94ef2f29379d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:32.378204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58987077-9fd8-4e4f-9b35-94ef2f29379d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:32.378204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58987077-9fd8-4e4f-9b35-94ef2f29379d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:32.449105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9c15f-9f5f-4500-8279-4008ae187dcf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:32.468576 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:32.489731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b482-d5c5-43c3-81fa-ccb9e526a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:32.490767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b482-d5c5-43c3-81fa-ccb9e526a696 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:32.491282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b482-d5c5-43c3-81fa-ccb9e526a696 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:32.491755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b482-d5c5-43c3-81fa-ccb9e526a696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:32.573004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58987077-9fd8-4e4f-9b35-94ef2f29379d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:32.573452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1b482-d5c5-43c3-81fa-ccb9e526a696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:32.574499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58987077-9fd8-4e4f-9b35-94ef2f29379d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:32.575113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1b482-d5c5-43c3-81fa-ccb9e526a696 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:32.684045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 139/264] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:03:32.690371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b482-d5c5-43c3-81fa-ccb9e526a696 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:32.720609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:32.798683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b482-d5c5-43c3-81fa-ccb9e526a696 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:32.836445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e40e5b-7609-4355-9355-bbc45633b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:32.838012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e40e5b-7609-4355-9355-bbc45633b620 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:32.838447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e40e5b-7609-4355-9355-bbc45633b620 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:32.838826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e40e5b-7609-4355-9355-bbc45633b620 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:32.840409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e40e5b-7609-4355-9355-bbc45633b620 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:32.842146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e40e5b-7609-4355-9355-bbc45633b620 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:32.845036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 140/265] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:32 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:32.850840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e40e5b-7609-4355-9355-bbc45633b620 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:32.905831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:32.948509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:32.964484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e40e5b-7609-4355-9355-bbc45633b620 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:32.967045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 126/266] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 933 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:32.977232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58987077-9fd8-4e4f-9b35-94ef2f29379d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:33.003472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:33.004160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.004453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.004733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.005746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] RBAC: Adding query filter params (role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb, user.id=cbb0d059d0d3423988db23a74136827b) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:33.006063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:33.007899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:33.015373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 141/267] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:32 2022] GET /identity/v3/role_assignments?user.id=cbb0d059d0d3423988db23a74136827b&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:33.183682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58987077-9fd8-4e4f-9b35-94ef2f29379d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:33.225869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de624ac3-e31a-46b9-ba5d-227bd1b90ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:33.226749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de624ac3-e31a-46b9-ba5d-227bd1b90ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.227321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de624ac3-e31a-46b9-ba5d-227bd1b90ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.227321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de624ac3-e31a-46b9-ba5d-227bd1b90ed6 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.228497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de624ac3-e31a-46b9-ba5d-227bd1b90ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:33.230063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de624ac3-e31a-46b9-ba5d-227bd1b90ed6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:33.232118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 127/268] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:32 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:33.237985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:33.365315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e17ba-338d-4335-a74e-bb3ecfef4190 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:33.403097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e843db2-96ef-4fb5-a7b8-d10ea80286f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:33.403097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e843db2-96ef-4fb5-a7b8-d10ea80286f7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.403097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e843db2-96ef-4fb5-a7b8-d10ea80286f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.403097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e843db2-96ef-4fb5-a7b8-d10ea80286f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.404601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e843db2-96ef-4fb5-a7b8-d10ea80286f7 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb, user.id=cbb0d059d0d3423988db23a74136827b) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:33.404601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e843db2-96ef-4fb5-a7b8-d10ea80286f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:33.405471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e843db2-96ef-4fb5-a7b8-d10ea80286f7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:33.412538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 142/269] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:33 2022] GET /identity/v3/role_assignments?user.id=cbb0d059d0d3423988db23a74136827b&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:33.433496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264568-f3c0-4bf7-baf3-9e1a55a91d0e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.433813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264568-f3c0-4bf7-baf3-9e1a55a91d0e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.434048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e264568-f3c0-4bf7-baf3-9e1a55a91d0e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.437488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 128/270] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:33.450128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00562e9-e488-4dcf-9f5f-5312574fc250 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.450440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00562e9-e488-4dcf-9f5f-5312574fc250 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.450697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00562e9-e488-4dcf-9f5f-5312574fc250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.468979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e00562e9-e488-4dcf-9f5f-5312574fc250 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:33.470300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e00562e9-e488-4dcf-9f5f-5312574fc250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:33.473653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:33.541278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941d852-d803-4a8d-bf1a-85c05bcabaab None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.541900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941d852-d803-4a8d-bf1a-85c05bcabaab None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.542379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941d852-d803-4a8d-bf1a-85c05bcabaab None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.544332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 129/271] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:33.551902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13fe6-712f-43d7-8d7e-cd8e62b13e54 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.552548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13fe6-712f-43d7-8d7e-cd8e62b13e54 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.553026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b13fe6-712f-43d7-8d7e-cd8e62b13e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.569980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 143/272] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:33.574317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cef7d-49cf-4126-a2c8-17ec84897497 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.574317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cef7d-49cf-4126-a2c8-17ec84897497 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.574317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cef7d-49cf-4126-a2c8-17ec84897497 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.574317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 144/273] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:33.579140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1819df-8992-491a-94a6-7293a2a0a94e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.579516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1819df-8992-491a-94a6-7293a2a0a94e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.579693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1819df-8992-491a-94a6-7293a2a0a94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.585700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-39b13fe6-712f-43d7-8d7e-cd8e62b13e54 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:33.587286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-39b13fe6-712f-43d7-8d7e-cd8e62b13e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:33.598580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3d1819df-8992-491a-94a6-7293a2a0a94e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:33.600024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3d1819df-8992-491a-94a6-7293a2a0a94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:33.669651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:33.695774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 130/274] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:33.697470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b13fe6-712f-43d7-8d7e-cd8e62b13e54 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:33.705868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 145/275] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:33.720476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1819df-8992-491a-94a6-7293a2a0a94e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:33.801485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:33.808984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b13fe6-712f-43d7-8d7e-cd8e62b13e54 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:33.838909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1819df-8992-491a-94a6-7293a2a0a94e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:33.845414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba457dee-0b90-434e-a197-975a0d2b9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:33.846267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba457dee-0b90-434e-a197-975a0d2b9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.846555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba457dee-0b90-434e-a197-975a0d2b9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.846832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba457dee-0b90-434e-a197-975a0d2b9ea2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.848145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba457dee-0b90-434e-a197-975a0d2b9ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:33.849726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba457dee-0b90-434e-a197-975a0d2b9ea2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:33.856030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 131/276] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:33.856030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba457dee-0b90-434e-a197-975a0d2b9ea2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:33.880242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141914ed-b7b2-41ed-8e94-63b95f05258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:33.881053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141914ed-b7b2-41ed-8e94-63b95f05258d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:33.881338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141914ed-b7b2-41ed-8e94-63b95f05258d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:33.881613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141914ed-b7b2-41ed-8e94-63b95f05258d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:33.892398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141914ed-b7b2-41ed-8e94-63b95f05258d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-141914ed-b7b2-41ed-8e94-63b95f05258d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:33.900258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:33.901167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:33.902005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 146/277] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:33.902659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141914ed-b7b2-41ed-8e94-63b95f05258d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:33.921844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:33.978134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba457dee-0b90-434e-a197-975a0d2b9ea2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.014663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23c1c3-f93c-4d4b-a8cd-947372f57572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.015468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c1c3-f93c-4d4b-a8cd-947372f57572 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.015956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c1c3-f93c-4d4b-a8cd-947372f57572 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.016062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c1c3-f93c-4d4b-a8cd-947372f57572 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.018691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141914ed-b7b2-41ed-8e94-63b95f05258d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.031321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23c1c3-f93c-4d4b-a8cd-947372f57572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1b23c1c3-f93c-4d4b-a8cd-947372f57572 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:34.039748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:34.040823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:34.041652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 132/278] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:34.042314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23c1c3-f93c-4d4b-a8cd-947372f57572 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:34.058391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:34.065261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae01aeb-31d6-4763-81ac-bb50bbeb822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.066191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01aeb-31d6-4763-81ac-bb50bbeb822a None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.066473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01aeb-31d6-4763-81ac-bb50bbeb822a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.066744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae01aeb-31d6-4763-81ac-bb50bbeb822a None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.067456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae01aeb-31d6-4763-81ac-bb50bbeb822a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:34.068938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae01aeb-31d6-4763-81ac-bb50bbeb822a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:34.100132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 147/279] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:33 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:03:34.100132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae01aeb-31d6-4763-81ac-bb50bbeb822a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:34.167096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23c1c3-f93c-4d4b-a8cd-947372f57572 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.184095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:34.211108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.211954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.212330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.212720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.213568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:34.213959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:34.215465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:34.225747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 133/280] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:34.231439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:34.240734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae01aeb-31d6-4763-81ac-bb50bbeb822a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.279220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.281354 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.281729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.282092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.282871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:34.283262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:34.284625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:34.294063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 148/281] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:34.299066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:34.356525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061142f2-5db6-4990-b788-cbe66e337511 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.368382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:34.412981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec4e30-9a69-43c6-8169-364e4954e201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.413884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec4e30-9a69-43c6-8169-364e4954e201 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.414165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec4e30-9a69-43c6-8169-364e4954e201 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.414438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec4e30-9a69-43c6-8169-364e4954e201 None admin] PATH_INFO: `/v3/users/5b8579a291524a50bb52eb07fc6a2020` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.415655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec4e30-9a69-43c6-8169-364e4954e201 None admin] RBAC: Authorizing `identity:get_user(user_id=5b8579a291524a50bb52eb07fc6a2020)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:34.417133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec4e30-9a69-43c6-8169-364e4954e201 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:34.419042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 134/282] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:34 2022] GET /identity/v3/users/5b8579a291524a50bb52eb07fc6a2020 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:34.424313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec4e30-9a69-43c6-8169-364e4954e201 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:34.437668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15135398-5f2a-4e1c-af0e-1d2d6aed1d55 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.487356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:34.487666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb072-d873-41ad-be2e-bff90ec4ccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.489678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb072-d873-41ad-be2e-bff90ec4ccdf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.489959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb072-d873-41ad-be2e-bff90ec4ccdf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.490317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb072-d873-41ad-be2e-bff90ec4ccdf None admin] PATH_INFO: `/v3/users/ab52eb4aaf934405978e000910e3d74a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.510890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb072-d873-41ad-be2e-bff90ec4ccdf None admin] RBAC: Authorizing `identity:get_user(user_id=ab52eb4aaf934405978e000910e3d74a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:34.512401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb072-d873-41ad-be2e-bff90ec4ccdf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:34.514874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 149/283] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:34 2022] GET /identity/v3/users/ab52eb4aaf934405978e000910e3d74a => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:34.520770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb072-d873-41ad-be2e-bff90ec4ccdf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:34.574246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec4e30-9a69-43c6-8169-364e4954e201 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.622179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306626-7b03-48cb-b602-b434d586e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.623160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306626-7b03-48cb-b602-b434d586e964 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.624072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306626-7b03-48cb-b602-b434d586e964 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.624471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44306626-7b03-48cb-b602-b434d586e964 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.626055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306626-7b03-48cb-b602-b434d586e964 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:34.627611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44306626-7b03-48cb-b602-b434d586e964 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:34.629949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 135/284] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:34 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:34.638917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306626-7b03-48cb-b602-b434d586e964 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:34.648798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb072-d873-41ad-be2e-bff90ec4ccdf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.657051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:34.687076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766797c-0825-4e40-8307-c51ac9632890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.688162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766797c-0825-4e40-8307-c51ac9632890 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.688821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766797c-0825-4e40-8307-c51ac9632890 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.689409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766797c-0825-4e40-8307-c51ac9632890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.690493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766797c-0825-4e40-8307-c51ac9632890 None admin] RBAC: Adding query filter params (role.id=3c87a6985254480b960b2a9ddfc5d7cc, user.id=ab52eb4aaf934405978e000910e3d74a, scope.system=all) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:34.691270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766797c-0825-4e40-8307-c51ac9632890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:34.693203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766797c-0825-4e40-8307-c51ac9632890 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:34.699469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 150/285] 10.222.0.17 () {56 vars in 1308 bytes} [Thu Jul 14 11:03:34 2022] GET /identity/v3/role_assignments?user.id=ab52eb4aaf934405978e000910e3d74a&scope.system=all&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:34.788307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44306626-7b03-48cb-b602-b434d586e964 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:34.799916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:34.843532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64007dce-49c3-4611-80c5-fbc0dc55cceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:34.844493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64007dce-49c3-4611-80c5-fbc0dc55cceb None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:34.844781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64007dce-49c3-4611-80c5-fbc0dc55cceb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:34.845060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64007dce-49c3-4611-80c5-fbc0dc55cceb None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/users/5b8579a291524a50bb52eb07fc6a2020/roles/830a10d3893c4f1ba36a2145058dfac3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:34.847662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64007dce-49c3-4611-80c5-fbc0dc55cceb None admin] RBAC: Authorizing `identity:create_grant(project_id=6560cdd2158e448ea29d06c8dc4e7ddb, user_id=5b8579a291524a50bb52eb07fc6a2020, role_id=830a10d3893c4f1ba36a2145058dfac3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:34.849211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64007dce-49c3-4611-80c5-fbc0dc55cceb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:34.869035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 136/286] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:03:34 2022] PUT /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/users/5b8579a291524a50bb52eb07fc6a2020/roles/830a10d3893c4f1ba36a2145058dfac3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:35.167624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6afe3-a177-4b8f-a0cb-2394f183486a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:35.168402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6afe3-a177-4b8f-a0cb-2394f183486a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:35.169189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6afe3-a177-4b8f-a0cb-2394f183486a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:35.171467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 151/287] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:35.177085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77b29-ce63-48a3-8c5b-d5d1161e48fd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:35.177672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77b29-ce63-48a3-8c5b-d5d1161e48fd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:35.178146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e77b29-ce63-48a3-8c5b-d5d1161e48fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:35.196975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c3e77b29-ce63-48a3-8c5b-d5d1161e48fd None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:35.198173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c3e77b29-ce63-48a3-8c5b-d5d1161e48fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:35.275410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 137/288] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:35.310922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6afe3-a177-4b8f-a0cb-2394f183486a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:35.419489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6afe3-a177-4b8f-a0cb-2394f183486a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:35.468796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797867d-0a5b-4bb7-8f8d-b0aa69907354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:35.469996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797867d-0a5b-4bb7-8f8d-b0aa69907354 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:35.470463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797867d-0a5b-4bb7-8f8d-b0aa69907354 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:35.470950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797867d-0a5b-4bb7-8f8d-b0aa69907354 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:35.484230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797867d-0a5b-4bb7-8f8d-b0aa69907354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6797867d-0a5b-4bb7-8f8d-b0aa69907354 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:35.492955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:35.493864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:35.494681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:35.500454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 152/289] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:35.503261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77b29-ce63-48a3-8c5b-d5d1161e48fd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:35.626276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:35.635108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e77b29-ce63-48a3-8c5b-d5d1161e48fd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:35.687967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:35.688598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:35.688882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:35.689161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:35.689937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:35.690247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:35.691959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:35.701455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 138/290] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:35.711001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797867d-0a5b-4bb7-8f8d-b0aa69907354 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:35.780854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:35.900119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797867d-0a5b-4bb7-8f8d-b0aa69907354 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:35.947272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66594121-8947-42b1-af48-2787534fc990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:35.948591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66594121-8947-42b1-af48-2787534fc990 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:35.949102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66594121-8947-42b1-af48-2787534fc990 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:35.949590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66594121-8947-42b1-af48-2787534fc990 None admin] PATH_INFO: `/v3/users/49ee7e03b1014e92b149d6890a683008` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:35.956874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66594121-8947-42b1-af48-2787534fc990 None admin] RBAC: Authorizing `identity:get_user(user_id=49ee7e03b1014e92b149d6890a683008)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:35.958589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66594121-8947-42b1-af48-2787534fc990 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:35.960812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 153/291] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:35 2022] GET /identity/v3/users/49ee7e03b1014e92b149d6890a683008 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:35.966612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:36.110219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060fc2da-9817-4887-b1ae-1fba7a0b2337 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:36.161748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1d6b-9be1-40d1-b857-1abd758585e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:36.162770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1d6b-9be1-40d1-b857-1abd758585e5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:36.163266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1d6b-9be1-40d1-b857-1abd758585e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:36.163732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d1d6b-9be1-40d1-b857-1abd758585e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:36.201153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:36.248423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1d6b-9be1-40d1-b857-1abd758585e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:36.250504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d1d6b-9be1-40d1-b857-1abd758585e5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:36.396524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 139/292] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:36.405228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66594121-8947-42b1-af48-2787534fc990 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:36.549560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:36.553615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66594121-8947-42b1-af48-2787534fc990 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:36.594900 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad1fb3-1426-4cf6-af71-dae094a64ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:36.595972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1fb3-1426-4cf6-af71-dae094a64ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:36.596289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1fb3-1426-4cf6-af71-dae094a64ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:36.596563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad1fb3-1426-4cf6-af71-dae094a64ec7 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:36.600907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad1fb3-1426-4cf6-af71-dae094a64ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:36.602499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad1fb3-1426-4cf6-af71-dae094a64ec7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:36.604653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 154/293] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:36 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:36.611547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1d6b-9be1-40d1-b857-1abd758585e5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:36.725813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:36.785677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d1d6b-9be1-40d1-b857-1abd758585e5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:36.834252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a6eac-0756-4c4e-be74-17c6c3eba262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:36.835272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6eac-0756-4c4e-be74-17c6c3eba262 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:36.835747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6eac-0756-4c4e-be74-17c6c3eba262 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:36.836282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a6eac-0756-4c4e-be74-17c6c3eba262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:36.837312 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a6eac-0756-4c4e-be74-17c6c3eba262 None admin] RBAC: Adding query filter params (role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb, user.id=49ee7e03b1014e92b149d6890a683008) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:36.837822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a6eac-0756-4c4e-be74-17c6c3eba262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:36.839475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a6eac-0756-4c4e-be74-17c6c3eba262 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:36.849083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 140/294] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:36 2022] GET /identity/v3/role_assignments?user.id=49ee7e03b1014e92b149d6890a683008&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:36.892851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5783-26b8-40fc-8acd-b08d4961b246 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:36.893154 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5783-26b8-40fc-8acd-b08d4961b246 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:36.893435 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d5783-26b8-40fc-8acd-b08d4961b246 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:36.895047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 155/295] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:36.900468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab05-863b-4498-9520-1b0ff4c49bee None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:36.901043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab05-863b-4498-9520-1b0ff4c49bee None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:36.901549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cab05-863b-4498-9520-1b0ff4c49bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:36.924852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fe0cab05-863b-4498-9520-1b0ff4c49bee None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:36.926469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fe0cab05-863b-4498-9520-1b0ff4c49bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:37.038531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 141/296] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:37.061456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5783-26b8-40fc-8acd-b08d4961b246 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:37.133742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2f18-8586-4162-93af-bb768f2acf25 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.134348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2f18-8586-4162-93af-bb768f2acf25 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.134818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e2f18-8586-4162-93af-bb768f2acf25 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.136457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 142/297] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:37.143111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173542ea-f3e2-468f-809e-efa5f005b599 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.143412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173542ea-f3e2-468f-809e-efa5f005b599 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.143670 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173542ea-f3e2-468f-809e-efa5f005b599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.162895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-173542ea-f3e2-468f-809e-efa5f005b599 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:37.164118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-173542ea-f3e2-468f-809e-efa5f005b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:37.182115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d5783-26b8-40fc-8acd-b08d4961b246 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:37.222371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:37.228572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b4ec1-bf62-433b-b9a3-8549601e5481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:37.230053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b4ec1-bf62-433b-b9a3-8549601e5481 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.230053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b4ec1-bf62-433b-b9a3-8549601e5481 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.230053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b4ec1-bf62-433b-b9a3-8549601e5481 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.231833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b4ec1-bf62-433b-b9a3-8549601e5481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:37.233707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b4ec1-bf62-433b-b9a3-8549601e5481 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:37.236196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 156/298] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:37.237480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19c42-76a7-4e4f-91eb-eaf5a9998b31 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.237770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19c42-76a7-4e4f-91eb-eaf5a9998b31 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.238056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd19c42-76a7-4e4f-91eb-eaf5a9998b31 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.239343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 157/299] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:37.245315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19c42-76a7-4e4f-91eb-eaf5a9998b31 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:37.252225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 143/300] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:37.253628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cd87-8ab0-4e98-b737-e0e0f7f46dc1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.253917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cd87-8ab0-4e98-b737-e0e0f7f46dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.254197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cd87-8ab0-4e98-b737-e0e0f7f46dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.286175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:37.288029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c921cd87-8ab0-4e98-b737-e0e0f7f46dc1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:37.289371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c921cd87-8ab0-4e98-b737-e0e0f7f46dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:37.364348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 144/301] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:37.372472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921cd87-8ab0-4e98-b737-e0e0f7f46dc1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:37.372553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd19c42-76a7-4e4f-91eb-eaf5a9998b31 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:37.409752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affee3f-5f2d-4e19-b722-71ab0130bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:37.410892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affee3f-5f2d-4e19-b722-71ab0130bc75 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.411500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affee3f-5f2d-4e19-b722-71ab0130bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.411967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affee3f-5f2d-4e19-b722-71ab0130bc75 None admin] PATH_INFO: `/v3/groups` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.412703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affee3f-5f2d-4e19-b722-71ab0130bc75 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:37.414180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affee3f-5f2d-4e19-b722-71ab0130bc75 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:37.433833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 158/302] 10.222.0.17 () {60 vars in 1134 bytes} [Thu Jul 14 11:03:37 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:03:37.445591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affee3f-5f2d-4e19-b722-71ab0130bc75 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:37.495773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921cd87-8ab0-4e98-b737-e0e0f7f46dc1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:37.520645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:37.547123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327c17c-d6b8-49e6-87c8-9da50c227061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:37.547993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327c17c-d6b8-49e6-87c8-9da50c227061 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.548335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327c17c-d6b8-49e6-87c8-9da50c227061 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.548612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327c17c-d6b8-49e6-87c8-9da50c227061 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.562940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327c17c-d6b8-49e6-87c8-9da50c227061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9327c17c-d6b8-49e6-87c8-9da50c227061 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:37.571707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:37.572718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:37.574772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 145/303] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:37.580036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327c17c-d6b8-49e6-87c8-9da50c227061 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:37.605027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:37.614674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affee3f-5f2d-4e19-b722-71ab0130bc75 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:37.653644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f59cb-a4ff-4173-b5a3-a0ce384c636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:37.654450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f59cb-a4ff-4173-b5a3-a0ce384c636d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.654766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f59cb-a4ff-4173-b5a3-a0ce384c636d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.655044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f59cb-a4ff-4173-b5a3-a0ce384c636d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.669713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f59cb-a4ff-4173-b5a3-a0ce384c636d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-098f59cb-a4ff-4173-b5a3-a0ce384c636d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:37.678563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:37.679547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:37.680394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 159/304] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:37.686485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f59cb-a4ff-4173-b5a3-a0ce384c636d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:37.734321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327c17c-d6b8-49e6-87c8-9da50c227061 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:37.788537 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:37.789220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.789538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.789814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.790575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:37.790871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:37.792357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:37.801532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 146/305] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:37.805676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f59cb-a4ff-4173-b5a3-a0ce384c636d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:37.806963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:37.845357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec183f-a38a-418b-91f3-e7f5b57962ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:37.846332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec183f-a38a-418b-91f3-e7f5b57962ba None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.846814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec183f-a38a-418b-91f3-e7f5b57962ba None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.847274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec183f-a38a-418b-91f3-e7f5b57962ba None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.848242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec183f-a38a-418b-91f3-e7f5b57962ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:37.848735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec183f-a38a-418b-91f3-e7f5b57962ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:37.849303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:37.850179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec183f-a38a-418b-91f3-e7f5b57962ba None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:37.864936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 160/306] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:37.864936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f108-ef7d-4b2c-b660-9709d82dd5aa None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.864936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f108-ef7d-4b2c-b660-9709d82dd5aa None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.864936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8f108-ef7d-4b2c-b660-9709d82dd5aa None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.864936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 161/307] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:37.867099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8f108-ef7d-4b2c-b660-9709d82dd5aa None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:37.887246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:37.928832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6353a-8c15-4f41-9d36-71a477afb9af None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:37.973634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f39232-bc16-49ff-ab69-c7a87b2cb1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:37.974550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f39232-bc16-49ff-ab69-c7a87b2cb1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.974835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f39232-bc16-49ff-ab69-c7a87b2cb1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.975110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f39232-bc16-49ff-ab69-c7a87b2cb1d5 None admin] PATH_INFO: `/v3/users/c6860d92114941a095b44e7c8d8442ec` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:37.978657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8f108-ef7d-4b2c-b660-9709d82dd5aa None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:37.990682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f39232-bc16-49ff-ab69-c7a87b2cb1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=c6860d92114941a095b44e7c8d8442ec)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:37.992165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f39232-bc16-49ff-ab69-c7a87b2cb1d5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:37.994061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 147/308] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:37 2022] GET /identity/v3/users/c6860d92114941a095b44e7c8d8442ec => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:37.995097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5d719-d818-49f3-9d9f-82a2812c21e6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:37.995377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5d719-d818-49f3-9d9f-82a2812c21e6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:37.995649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5d719-d818-49f3-9d9f-82a2812c21e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:38.013919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-66b5d719-d818-49f3-9d9f-82a2812c21e6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:38.015131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-66b5d719-d818-49f3-9d9f-82a2812c21e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:38.021042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a146-a90e-4b00-9f40-16da6140e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:38.021915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a146-a90e-4b00-9f40-16da6140e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:38.022195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a146-a90e-4b00-9f40-16da6140e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:38.022465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536a146-a90e-4b00-9f40-16da6140e4a5 None admin] PATH_INFO: `/v3/users/ab52eb4aaf934405978e000910e3d74a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:38.023672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536a146-a90e-4b00-9f40-16da6140e4a5 None admin] RBAC: Authorizing `identity:get_user(user_id=ab52eb4aaf934405978e000910e3d74a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:38.025187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536a146-a90e-4b00-9f40-16da6140e4a5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:38.031365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 162/309] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:37 2022] GET /identity/v3/users/ab52eb4aaf934405978e000910e3d74a => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:38.031365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a146-a90e-4b00-9f40-16da6140e4a5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:38.094383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 148/310] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:38.104470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5d719-d818-49f3-9d9f-82a2812c21e6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:38.125185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:38.132080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:38.143136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536a146-a90e-4b00-9f40-16da6140e4a5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:38.180512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:38.180841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:38.181024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:38.181291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:38.182156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] RBAC: Adding query filter params (role.id=830a10d3893c4f1ba36a2145058dfac3, user.id=c6860d92114941a095b44e7c8d8442ec, scope.system=all) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:38.182469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:38.183939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:38.190472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 163/311] 10.222.0.17 () {56 vars in 1308 bytes} [Thu Jul 14 11:03:38 2022] GET /identity/v3/role_assignments?user.id=c6860d92114941a095b44e7c8d8442ec&scope.system=all&role.id=830a10d3893c4f1ba36a2145058dfac3 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:38.191381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:38.217960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5d719-d818-49f3-9d9f-82a2812c21e6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:38.273760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921f0d-0c6b-46e8-8e27-34acf4838be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:38.274990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921f0d-0c6b-46e8-8e27-34acf4838be2 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:38.275277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921f0d-0c6b-46e8-8e27-34acf4838be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:38.275557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921f0d-0c6b-46e8-8e27-34acf4838be2 None admin] PATH_INFO: `/v3/system/users/ab52eb4aaf934405978e000910e3d74a/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:38.278360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63921f0d-0c6b-46e8-8e27-34acf4838be2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ab52eb4aaf934405978e000910e3d74a, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:38.280757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63921f0d-0c6b-46e8-8e27-34acf4838be2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:38.296951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 149/312] 10.222.0.17 () {58 vars in 1334 bytes} [Thu Jul 14 11:03:38 2022] PUT /identity/v3/system/users/ab52eb4aaf934405978e000910e3d74a/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:38.333459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126323e-2c50-405a-ac58-178865999a76 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:38.378178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc77e8-aa9c-4f52-ba8d-236e77720fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:38.378925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc77e8-aa9c-4f52-ba8d-236e77720fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:38.379206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc77e8-aa9c-4f52-ba8d-236e77720fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:38.379480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc77e8-aa9c-4f52-ba8d-236e77720fb8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:38.392186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc77e8-aa9c-4f52-ba8d-236e77720fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-01cc77e8-aa9c-4f52-ba8d-236e77720fb8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:38.400700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:38.401680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:38.402494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 164/313] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:38.410323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921f0d-0c6b-46e8-8e27-34acf4838be2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:38.514587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:38.526957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921f0d-0c6b-46e8-8e27-34acf4838be2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:38.563940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:38.564657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:38.564942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:38.565219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:38.566239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:38.566549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:38.567937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:38.577156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 150/314] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:38.582740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc77e8-aa9c-4f52-ba8d-236e77720fb8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:38.595978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:38.696921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc77e8-aa9c-4f52-ba8d-236e77720fb8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:38.736314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39254e-8687-4dc0-913f-50d13cf6f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:38.737207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39254e-8687-4dc0-913f-50d13cf6f892 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:38.737491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39254e-8687-4dc0-913f-50d13cf6f892 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:38.737766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39254e-8687-4dc0-913f-50d13cf6f892 None admin] PATH_INFO: `/v3/users/5b8579a291524a50bb52eb07fc6a2020` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:38.739218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39254e-8687-4dc0-913f-50d13cf6f892 None admin] RBAC: Authorizing `identity:get_user(user_id=5b8579a291524a50bb52eb07fc6a2020)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:38.740736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39254e-8687-4dc0-913f-50d13cf6f892 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:38.742676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 165/315] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:38 2022] GET /identity/v3/users/5b8579a291524a50bb52eb07fc6a2020 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:38.748242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:38.856086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd18c46-4e8c-4841-933a-397e78d8eb90 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:38.890721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99be95-b1e7-4cf1-b72d-c067c1400e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:38.891386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99be95-b1e7-4cf1-b72d-c067c1400e1b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:38.891724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99be95-b1e7-4cf1-b72d-c067c1400e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:38.892007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99be95-b1e7-4cf1-b72d-c067c1400e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:38.916810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:38.965867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99be95-b1e7-4cf1-b72d-c067c1400e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:38.967823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99be95-b1e7-4cf1-b72d-c067c1400e1b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:39.070628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 151/316] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:39.076313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39254e-8687-4dc0-913f-50d13cf6f892 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:39.163856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:39.189387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39254e-8687-4dc0-913f-50d13cf6f892 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:39.226104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a1d31-25e7-416d-beba-6bd15395f056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:39.227298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a1d31-25e7-416d-beba-6bd15395f056 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:39.227801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a1d31-25e7-416d-beba-6bd15395f056 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:39.228309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a1d31-25e7-416d-beba-6bd15395f056 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:39.229763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a1d31-25e7-416d-beba-6bd15395f056 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:39.231425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a1d31-25e7-416d-beba-6bd15395f056 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:39.233767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 166/317] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:39 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:39.239302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99be95-b1e7-4cf1-b72d-c067c1400e1b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:39.304545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:39.345180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99be95-b1e7-4cf1-b72d-c067c1400e1b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:39.382620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e377276-8894-486b-afbb-5b7a6139c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:39.383349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377276-8894-486b-afbb-5b7a6139c7de None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:39.383641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377276-8894-486b-afbb-5b7a6139c7de None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:39.383921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e377276-8894-486b-afbb-5b7a6139c7de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:39.384800 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e377276-8894-486b-afbb-5b7a6139c7de None admin] RBAC: Adding query filter params (role.id=830a10d3893c4f1ba36a2145058dfac3, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb, user.id=5b8579a291524a50bb52eb07fc6a2020) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:39.386623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e377276-8894-486b-afbb-5b7a6139c7de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:39.390573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e377276-8894-486b-afbb-5b7a6139c7de None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:39.397663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 152/318] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:03:39 2022] GET /identity/v3/role_assignments?user.id=5b8579a291524a50bb52eb07fc6a2020&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=830a10d3893c4f1ba36a2145058dfac3 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:39.662638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265cfea-6977-4c3a-9f45-fef2210ebeb3 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:39.662995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265cfea-6977-4c3a-9f45-fef2210ebeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:39.663190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265cfea-6977-4c3a-9f45-fef2210ebeb3 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:39.664618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 167/319] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:39.672489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250805-6ef9-423d-8426-a8145dc958c0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:39.672968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250805-6ef9-423d-8426-a8145dc958c0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:39.673114 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250805-6ef9-423d-8426-a8145dc958c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:39.695949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6f250805-6ef9-423d-8426-a8145dc958c0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:39.697163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6f250805-6ef9-423d-8426-a8145dc958c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:39.763974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 153/320] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:39.786510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265cfea-6977-4c3a-9f45-fef2210ebeb3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:39.891257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265cfea-6977-4c3a-9f45-fef2210ebeb3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:39.925549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6db820-51ef-48de-ab8a-d518592464a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:39.926345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6db820-51ef-48de-ab8a-d518592464a4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:39.926628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6db820-51ef-48de-ab8a-d518592464a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:39.926903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6db820-51ef-48de-ab8a-d518592464a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:39.928059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6db820-51ef-48de-ab8a-d518592464a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:39.929553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6db820-51ef-48de-ab8a-d518592464a4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:39.931167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 168/321] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:39.936870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250805-6ef9-423d-8426-a8145dc958c0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:39.985096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:40.054711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250805-6ef9-423d-8426-a8145dc958c0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:40.115576 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af929086-70a3-4378-929e-6a8787f8b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:40.116757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929086-70a3-4378-929e-6a8787f8b7cd None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.117260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929086-70a3-4378-929e-6a8787f8b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.117759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af929086-70a3-4378-929e-6a8787f8b7cd None admin] PATH_INFO: `/v3/groups` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.119065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af929086-70a3-4378-929e-6a8787f8b7cd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:40.121829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af929086-70a3-4378-929e-6a8787f8b7cd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:40.145795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 154/322] 10.222.0.17 () {60 vars in 1134 bytes} [Thu Jul 14 11:03:39 2022] POST /identity/v3/groups => generated 226 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:03:40.435701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3e2f-29de-4bf5-b5f4-f21e9fd150fe None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.435981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3e2f-29de-4bf5-b5f4-f21e9fd150fe None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.436298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3e2f-29de-4bf5-b5f4-f21e9fd150fe None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.437676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 169/323] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:40.443726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde5d9-7e72-438d-99c8-22cc6938728f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.444039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde5d9-7e72-438d-99c8-22cc6938728f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.444493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde5d9-7e72-438d-99c8-22cc6938728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.462504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2cdde5d9-7e72-438d-99c8-22cc6938728f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:40.463747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2cdde5d9-7e72-438d-99c8-22cc6938728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:40.475238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9b6cc-317c-443a-a974-da7a4cb60149 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.475507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9b6cc-317c-443a-a974-da7a4cb60149 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.475788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9b6cc-317c-443a-a974-da7a4cb60149 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.477249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 170/324] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:40.484996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1a645-8558-4820-b76f-14d18d4ca34f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.485290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1a645-8558-4820-b76f-14d18d4ca34f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.485561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1a645-8558-4820-b76f-14d18d4ca34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.505268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-87b1a645-8558-4820-b76f-14d18d4ca34f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:40.506485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-87b1a645-8558-4820-b76f-14d18d4ca34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:40.515290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:40.554954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 155/325] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:40.581946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde5d9-7e72-438d-99c8-22cc6938728f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:40.594985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 171/326] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:40.618452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1a645-8558-4820-b76f-14d18d4ca34f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:40.631778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:40.725640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde5d9-7e72-438d-99c8-22cc6938728f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:40.744132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1a645-8558-4820-b76f-14d18d4ca34f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:40.765630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841a6e-f69a-4775-9a2f-5317af8fe772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:40.766904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841a6e-f69a-4775-9a2f-5317af8fe772 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.767392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841a6e-f69a-4775-9a2f-5317af8fe772 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.767866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f841a6e-f69a-4775-9a2f-5317af8fe772 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.780384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f841a6e-f69a-4775-9a2f-5317af8fe772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:40.781815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767aee-3f57-4870-8848-8e7360ffa4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:40.782730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767aee-3f57-4870-8848-8e7360ffa4bb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.783116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767aee-3f57-4870-8848-8e7360ffa4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.783513 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31767aee-3f57-4870-8848-8e7360ffa4bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0f841a6e-f69a-4775-9a2f-5317af8fe772 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:40.789780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:40.790779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:40.791589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:40.797849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31767aee-3f57-4870-8848-8e7360ffa4bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:40.798437 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 156/327] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:40.801237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841a6e-f69a-4775-9a2f-5317af8fe772 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-31767aee-3f57-4870-8848-8e7360ffa4bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:40.804568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:40.805660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:40.806461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:40.807376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 172/328] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:40.812978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767aee-3f57-4870-8848-8e7360ffa4bb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:40.816268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:40.917348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:40.923387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f841a6e-f69a-4775-9a2f-5317af8fe772 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:40.926670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31767aee-3f57-4870-8848-8e7360ffa4bb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:40.962515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:40.963517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:40.963789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.964299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.964403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:40.964709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:40.965060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.965196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:40.965913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:40.966285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:40.966519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:40.966998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:40.969232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:40.969717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:40.983413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 173/329] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:40.983869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 157/330] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:40.984935 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:40.985925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:41.051952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:41.094580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9146a-231a-4946-a8ec-f8110c5314cb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:41.102006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a949be-eb16-45f4-ba99-4940e609fb54 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:41.132000 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095328-3127-4d00-a920-11249b5bcc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:41.132937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095328-3127-4d00-a920-11249b5bcc2c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:41.133223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095328-3127-4d00-a920-11249b5bcc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:41.133496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095328-3127-4d00-a920-11249b5bcc2c None admin] PATH_INFO: `/v3/users/ab52eb4aaf934405978e000910e3d74a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:41.134992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2095328-3127-4d00-a920-11249b5bcc2c None admin] RBAC: Authorizing `identity:get_user(user_id=ab52eb4aaf934405978e000910e3d74a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:41.136419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2095328-3127-4d00-a920-11249b5bcc2c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:41.141142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 174/331] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:40 2022] GET /identity/v3/users/ab52eb4aaf934405978e000910e3d74a => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:41.144948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095328-3127-4d00-a920-11249b5bcc2c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:41.147371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532eb75-134c-4b92-9c15-f8c60ee6ec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:41.148682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532eb75-134c-4b92-9c15-f8c60ee6ec0b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:41.149226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532eb75-134c-4b92-9c15-f8c60ee6ec0b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:41.149703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532eb75-134c-4b92-9c15-f8c60ee6ec0b None admin] PATH_INFO: `/v3/users/c6860d92114941a095b44e7c8d8442ec` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:41.151187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532eb75-134c-4b92-9c15-f8c60ee6ec0b None admin] RBAC: Authorizing `identity:get_user(user_id=c6860d92114941a095b44e7c8d8442ec)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:41.152968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532eb75-134c-4b92-9c15-f8c60ee6ec0b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:41.161597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 158/332] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:40 2022] GET /identity/v3/users/c6860d92114941a095b44e7c8d8442ec => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:41.163482 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532eb75-134c-4b92-9c15-f8c60ee6ec0b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:41.212590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:41.256980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095328-3127-4d00-a920-11249b5bcc2c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:41.277184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532eb75-134c-4b92-9c15-f8c60ee6ec0b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:41.288642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:41.293694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab9076-d771-44d8-a4de-9d55a2c93570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:41.294361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab9076-d771-44d8-a4de-9d55a2c93570 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:41.294651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab9076-d771-44d8-a4de-9d55a2c93570 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:41.294933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab9076-d771-44d8-a4de-9d55a2c93570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:41.296156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab9076-d771-44d8-a4de-9d55a2c93570 None admin] RBAC: Adding query filter params (role.id=3c87a6985254480b960b2a9ddfc5d7cc, user.id=ab52eb4aaf934405978e000910e3d74a, scope.system=all) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:41.296269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab9076-d771-44d8-a4de-9d55a2c93570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:41.297735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab9076-d771-44d8-a4de-9d55a2c93570 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:41.311486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 175/333] 10.222.0.17 () {56 vars in 1308 bytes} [Thu Jul 14 11:03:41 2022] GET /identity/v3/role_assignments?user.id=ab52eb4aaf934405978e000910e3d74a&scope.system=all&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:41.320739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb63473-c4d0-44dd-a21f-f87dbc58f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:41.322207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63473-c4d0-44dd-a21f-f87dbc58f494 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:41.322754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63473-c4d0-44dd-a21f-f87dbc58f494 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:41.323259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb63473-c4d0-44dd-a21f-f87dbc58f494 None admin] PATH_INFO: `/v3/system/users/c6860d92114941a095b44e7c8d8442ec/roles/830a10d3893c4f1ba36a2145058dfac3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:41.325892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb63473-c4d0-44dd-a21f-f87dbc58f494 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c6860d92114941a095b44e7c8d8442ec, role_id=830a10d3893c4f1ba36a2145058dfac3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:41.329002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb63473-c4d0-44dd-a21f-f87dbc58f494 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:41.341884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 159/334] 10.222.0.17 () {58 vars in 1334 bytes} [Thu Jul 14 11:03:41 2022] PUT /identity/v3/system/users/c6860d92114941a095b44e7c8d8442ec/roles/830a10d3893c4f1ba36a2145058dfac3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:42.666819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23419-17bc-4193-bf44-c4bc9d2cb7a1 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:42.667325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23419-17bc-4193-bf44-c4bc9d2cb7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:42.667431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23419-17bc-4193-bf44-c4bc9d2cb7a1 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:42.669018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 176/335] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:42.676018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d18f7f-86e7-45c1-9b93-ea11f139173d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:42.676544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d18f7f-86e7-45c1-9b93-ea11f139173d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:42.676624 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d18f7f-86e7-45c1-9b93-ea11f139173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:42.699774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-39d18f7f-86e7-45c1-9b93-ea11f139173d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:42.701044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-39d18f7f-86e7-45c1-9b93-ea11f139173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:42.790473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 160/336] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:42.838929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad23419-17bc-4193-bf44-c4bc9d2cb7a1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:42.963248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad23419-17bc-4193-bf44-c4bc9d2cb7a1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:43.004806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837101-fbd4-4276-8efa-44134f17c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:43.005623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837101-fbd4-4276-8efa-44134f17c611 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:43.005904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837101-fbd4-4276-8efa-44134f17c611 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:43.006176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837101-fbd4-4276-8efa-44134f17c611 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:43.018904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96837101-fbd4-4276-8efa-44134f17c611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-96837101-fbd4-4276-8efa-44134f17c611 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:43.026725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:43.027738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:43.028599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 177/337] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:43.035991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d18f7f-86e7-45c1-9b93-ea11f139173d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:43.068700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:43.160839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286143-8bb4-478c-894b-283919ebd578 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:43.161203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286143-8bb4-478c-894b-283919ebd578 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:43.161493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14286143-8bb4-478c-894b-283919ebd578 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:43.163030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 178/338] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:43.170653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d18f7f-86e7-45c1-9b93-ea11f139173d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:43.173264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f8ed1-00e3-4ef3-b03f-49cba08da95c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:43.174700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f8ed1-00e3-4ef3-b03f-49cba08da95c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:43.175186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f8ed1-00e3-4ef3-b03f-49cba08da95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:43.195300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fa5f8ed1-00e3-4ef3-b03f-49cba08da95c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:43.196865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fa5f8ed1-00e3-4ef3-b03f-49cba08da95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:43.233814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:43.234499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:43.234773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:43.235045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:43.235801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:43.236139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:43.237765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:43.253394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 161/339] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:43.259987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:43.288485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:43.327484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 179/340] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:43.361976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f8ed1-00e3-4ef3-b03f-49cba08da95c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:43.427893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:43.445586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc40948-1ba1-4722-8ce8-d37d55944dcd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:43.486785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096e00-8621-4222-801f-eb1ffafddec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:43.487825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096e00-8621-4222-801f-eb1ffafddec1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:43.488334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096e00-8621-4222-801f-eb1ffafddec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:43.488823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4096e00-8621-4222-801f-eb1ffafddec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:43.549695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f8ed1-00e3-4ef3-b03f-49cba08da95c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:43.567461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096e00-8621-4222-801f-eb1ffafddec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:43.569540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4096e00-8621-4222-801f-eb1ffafddec1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:43.617419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f0908-7ece-45f2-8637-b1be7dda27cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:43.618289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0908-7ece-45f2-8637-b1be7dda27cb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:43.618539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0908-7ece-45f2-8637-b1be7dda27cb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:43.618818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f0908-7ece-45f2-8637-b1be7dda27cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:43.645594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f0908-7ece-45f2-8637-b1be7dda27cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7c8f0908-7ece-45f2-8637-b1be7dda27cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:43.661555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:43.662539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:43.663384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 180/341] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:43.670615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:43.677182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f0908-7ece-45f2-8637-b1be7dda27cb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:43.692174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 162/342] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:43.697313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096e00-8621-4222-801f-eb1ffafddec1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:43.751092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:43.809171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4096e00-8621-4222-801f-eb1ffafddec1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:43.843578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f0908-7ece-45f2-8637-b1be7dda27cb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:43.852687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03639ae7-e3a2-42a8-89f3-988ded244648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:43.853936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03639ae7-e3a2-42a8-89f3-988ded244648 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:43.854515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03639ae7-e3a2-42a8-89f3-988ded244648 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:43.854991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03639ae7-e3a2-42a8-89f3-988ded244648 None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:43.856566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03639ae7-e3a2-42a8-89f3-988ded244648 None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:43.858407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03639ae7-e3a2-42a8-89f3-988ded244648 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:43.860420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 163/343] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:43 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:43.866049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03639ae7-e3a2-42a8-89f3-988ded244648 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:43.898317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:43.898922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:43.899212 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:43.899490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:43.900276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:43.900592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:43.902019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:43.915458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 181/344] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:43.921627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:43.928705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:44.026872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03639ae7-e3a2-42a8-89f3-988ded244648 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:44.067925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97e87f-59d6-4b52-883b-16de3825bac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:44.069263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e87f-59d6-4b52-883b-16de3825bac2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.069765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e87f-59d6-4b52-883b-16de3825bac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.070348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97e87f-59d6-4b52-883b-16de3825bac2 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.077281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97e87f-59d6-4b52-883b-16de3825bac2 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:44.079259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97e87f-59d6-4b52-883b-16de3825bac2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:44.081686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 164/345] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:43 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:44.083280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4433-036c-47c6-91f2-1b55ed3a63fd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.083773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4433-036c-47c6-91f2-1b55ed3a63fd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.084338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4433-036c-47c6-91f2-1b55ed3a63fd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.084533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14246c67-b386-4581-b9c7-5f85c7992ee3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:44.086163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:44.086819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 165/346] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:44.088474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4433-036c-47c6-91f2-1b55ed3a63fd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:44.134209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee659087-ebb5-41df-a909-90ae9dc8767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:44.136521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee659087-ebb5-41df-a909-90ae9dc8767f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.138538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee659087-ebb5-41df-a909-90ae9dc8767f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.139090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee659087-ebb5-41df-a909-90ae9dc8767f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.223207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4433-036c-47c6-91f2-1b55ed3a63fd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:44.227578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee659087-ebb5-41df-a909-90ae9dc8767f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:44.229390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee659087-ebb5-41df-a909-90ae9dc8767f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:44.238543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:44.263626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723eec-c066-4387-b3a5-0bd185ff044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:44.264375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723eec-c066-4387-b3a5-0bd185ff044a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.264662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723eec-c066-4387-b3a5-0bd185ff044a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.264941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723eec-c066-4387-b3a5-0bd185ff044a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.265792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723eec-c066-4387-b3a5-0bd185ff044a None admin] RBAC: Adding query filter params (group.id=d569872336eb46bc80a4415023fec7cf, role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:44.266112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723eec-c066-4387-b3a5-0bd185ff044a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:44.268570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723eec-c066-4387-b3a5-0bd185ff044a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:44.275732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 166/347] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:44 2022] GET /identity/v3/role_assignments?group.id=d569872336eb46bc80a4415023fec7cf&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:44.277066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300352-d6d3-40e0-bc8a-fea32d764f9c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.277359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300352-d6d3-40e0-bc8a-fea32d764f9c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.277640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95300352-d6d3-40e0-bc8a-fea32d764f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.312450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-95300352-d6d3-40e0-bc8a-fea32d764f9c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:44.314774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-95300352-d6d3-40e0-bc8a-fea32d764f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:44.411581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 182/348] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:03:44.417274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee659087-ebb5-41df-a909-90ae9dc8767f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:44.433022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:44.546911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 167/349] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:44.580040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300352-d6d3-40e0-bc8a-fea32d764f9c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:44.659954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee659087-ebb5-41df-a909-90ae9dc8767f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:44.773782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f697-e1b1-4851-8ade-dded511f6a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:44.774663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f697-e1b1-4851-8ade-dded511f6a70 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.774945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f697-e1b1-4851-8ade-dded511f6a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.775217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f697-e1b1-4851-8ade-dded511f6a70 None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.776456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f697-e1b1-4851-8ade-dded511f6a70 None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:44.777975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1f697-e1b1-4851-8ade-dded511f6a70 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:44.783814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95300352-d6d3-40e0-bc8a-fea32d764f9c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:44.788343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 183/350] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:44 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:44.790044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46add626-07ed-4072-b1ed-bbd2e5bd6963 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.790522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46add626-07ed-4072-b1ed-bbd2e5bd6963 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.790948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46add626-07ed-4072-b1ed-bbd2e5bd6963 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.792782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 184/351] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:44.793747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46add626-07ed-4072-b1ed-bbd2e5bd6963 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:44.797324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:44.832011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba3ca-87dc-4947-ac39-e5a45c64333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:44.833119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba3ca-87dc-4947-ac39-e5a45c64333d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.834006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba3ca-87dc-4947-ac39-e5a45c64333d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.834519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba3ca-87dc-4947-ac39-e5a45c64333d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.846682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba3ca-87dc-4947-ac39-e5a45c64333d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3edba3ca-87dc-4947-ac39-e5a45c64333d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:44.856502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:44.858210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:44.859109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:44.862353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 168/352] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:44.865582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4b79-50ab-490f-8e67-b0c67f79f346 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:44.865582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4b79-50ab-490f-8e67-b0c67f79f346 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:44.865582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda4b79-50ab-490f-8e67-b0c67f79f346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:44.899293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-afda4b79-50ab-490f-8e67-b0c67f79f346 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:44.901402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-afda4b79-50ab-490f-8e67-b0c67f79f346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:44.944456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:44.999373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46add626-07ed-4072-b1ed-bbd2e5bd6963 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:45.031438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 169/353] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:45.032726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda4b79-50ab-490f-8e67-b0c67f79f346 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:45.052310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913134f-8ca1-4bcf-a541-7b8c7bd49291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:45.053378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913134f-8ca1-4bcf-a541-7b8c7bd49291 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:45.053664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913134f-8ca1-4bcf-a541-7b8c7bd49291 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:45.053939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913134f-8ca1-4bcf-a541-7b8c7bd49291 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:45.055387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913134f-8ca1-4bcf-a541-7b8c7bd49291 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:45.057244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913134f-8ca1-4bcf-a541-7b8c7bd49291 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:45.064433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 185/354] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:44 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:45.068150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913134f-8ca1-4bcf-a541-7b8c7bd49291 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:45.146613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:45.150756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda4b79-50ab-490f-8e67-b0c67f79f346 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:45.204148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:45.205221 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:45.205708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:45.206184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:45.206302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913134f-8ca1-4bcf-a541-7b8c7bd49291 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:45.207296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:45.207933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:45.209697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:45.220031 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 170/355] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:45.221200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:45.248517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66917a-3fa7-4409-a48e-a3aec87d3dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:45.249440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66917a-3fa7-4409-a48e-a3aec87d3dbd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:45.249874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66917a-3fa7-4409-a48e-a3aec87d3dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:45.250298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66917a-3fa7-4409-a48e-a3aec87d3dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:45.251298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66917a-3fa7-4409-a48e-a3aec87d3dbd None admin] RBAC: Adding query filter params (group.id=d569872336eb46bc80a4415023fec7cf, role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:45.251753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66917a-3fa7-4409-a48e-a3aec87d3dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:45.254169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66917a-3fa7-4409-a48e-a3aec87d3dbd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:45.262150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 186/356] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:45 2022] GET /identity/v3/role_assignments?group.id=d569872336eb46bc80a4415023fec7cf&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:45.264359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6afb3-49da-4f6f-9140-386d2185098a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:45.264842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6afb3-49da-4f6f-9140-386d2185098a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:45.265270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6afb3-49da-4f6f-9140-386d2185098a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:45.268290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 187/357] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:45.269338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6afb3-49da-4f6f-9140-386d2185098a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:45.273693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:45.350311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf7273-bfc7-461f-baab-32ba1fb7a5e8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:45.400072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faa307-8295-4900-9fd8-678298ed964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:45.401183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa307-8295-4900-9fd8-678298ed964e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:45.401901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa307-8295-4900-9fd8-678298ed964e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:45.402333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa307-8295-4900-9fd8-678298ed964e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:45.410864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6afb3-49da-4f6f-9140-386d2185098a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:45.418118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faa307-8295-4900-9fd8-678298ed964e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-95faa307-8295-4900-9fd8-678298ed964e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:45.428534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:45.429531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:45.430349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 171/358] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:45.431536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a45396-325d-405d-848f-0ad992d0081a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:45.431705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a45396-325d-405d-848f-0ad992d0081a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:45.431968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a45396-325d-405d-848f-0ad992d0081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:45.462033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-44a45396-325d-405d-848f-0ad992d0081a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:45.463262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-44a45396-325d-405d-848f-0ad992d0081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:45.464962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faba70-1f18-4ae9-a760-23ad3d79183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:45.465892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faba70-1f18-4ae9-a760-23ad3d79183e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:45.466389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faba70-1f18-4ae9-a760-23ad3d79183e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:45.466886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faba70-1f18-4ae9-a760-23ad3d79183e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:45.483887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:45.575298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 172/359] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:45.578591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a45396-325d-405d-848f-0ad992d0081a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:45.583029 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faba70-1f18-4ae9-a760-23ad3d79183e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:45.585426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faba70-1f18-4ae9-a760-23ad3d79183e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:45.593696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:45.765513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a45396-325d-405d-848f-0ad992d0081a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:45.770182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 188/360] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:45.771234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faba70-1f18-4ae9-a760-23ad3d79183e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:45.828230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:45.830064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:45.830628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:45.831080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:45.832011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:45.832487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:45.834197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:45.845288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 173/361] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:45.846423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:45.870288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:45.976287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faba70-1f18-4ae9-a760-23ad3d79183e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:45.979719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:46.022440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a258-6eb6-44e4-a776-b75644134527 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:46.024663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8745a2c-f769-410c-8d71-435b238b9d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:46.025867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745a2c-f769-410c-8d71-435b238b9d1f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.026385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745a2c-f769-410c-8d71-435b238b9d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.026868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745a2c-f769-410c-8d71-435b238b9d1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.039994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8745a2c-f769-410c-8d71-435b238b9d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a8745a2c-f769-410c-8d71-435b238b9d1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:46.049232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:46.050254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:46.051047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:46.054750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 189/362] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:46.055927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8745a2c-f769-410c-8d71-435b238b9d1f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:46.062583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d6f23-5de9-4de5-b7ae-caa1a25c2c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:46.063467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d6f23-5de9-4de5-b7ae-caa1a25c2c37 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.063750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d6f23-5de9-4de5-b7ae-caa1a25c2c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.064023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d6f23-5de9-4de5-b7ae-caa1a25c2c37 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.065276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d6f23-5de9-4de5-b7ae-caa1a25c2c37 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:46.066999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d6f23-5de9-4de5-b7ae-caa1a25c2c37 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:46.069657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 174/363] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:45 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:46.071353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd05ae-5a9d-4302-900d-d2faf7ee2013 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.071656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd05ae-5a9d-4302-900d-d2faf7ee2013 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.071935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd05ae-5a9d-4302-900d-d2faf7ee2013 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.073668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 175/364] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:46.074459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd05ae-5a9d-4302-900d-d2faf7ee2013 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:46.188838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:46.192326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8745a2c-f769-410c-8d71-435b238b9d1f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:46.222626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd05ae-5a9d-4302-900d-d2faf7ee2013 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:46.241306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ed99-89e1-4e3a-998f-abea30605404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:46.242907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed99-89e1-4e3a-998f-abea30605404 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.243641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed99-89e1-4e3a-998f-abea30605404 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.244124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ed99-89e1-4e3a-998f-abea30605404 None admin] PATH_INFO: `/v3/users/c6860d92114941a095b44e7c8d8442ec` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.245696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ed99-89e1-4e3a-998f-abea30605404 None admin] RBAC: Authorizing `identity:get_user(user_id=c6860d92114941a095b44e7c8d8442ec)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:46.249030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ed99-89e1-4e3a-998f-abea30605404 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:46.251847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 190/365] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:03:46 2022] GET /identity/v3/users/c6860d92114941a095b44e7c8d8442ec => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:46.254469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8aa4c-d732-4b22-bc67-d78d7299e015 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.254916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8aa4c-d732-4b22-bc67-d78d7299e015 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.255367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8aa4c-d732-4b22-bc67-d78d7299e015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.271990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:46.272874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.273165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.273567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.274390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:46.274798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:46.276367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:46.277759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-81a8aa4c-d732-4b22-bc67-d78d7299e015 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:46.280056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-81a8aa4c-d732-4b22-bc67-d78d7299e015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:46.291806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 176/366] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:46.293067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:46.308396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:46.362717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 191/367] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:46.363821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8aa4c-d732-4b22-bc67-d78d7299e015 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:46.410648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186238fe-6507-47b3-9341-81b6bc3226f3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:46.452169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a87475-7776-44e6-8927-b547246ecfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:46.453303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87475-7776-44e6-8927-b547246ecfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.453736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87475-7776-44e6-8927-b547246ecfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.454138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a87475-7776-44e6-8927-b547246ecfb4 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.455500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a87475-7776-44e6-8927-b547246ecfb4 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:46.457152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a87475-7776-44e6-8927-b547246ecfb4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:46.459517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 177/368] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:46 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:46.460543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a87475-7776-44e6-8927-b547246ecfb4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:46.479023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:46.490223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8aa4c-d732-4b22-bc67-d78d7299e015 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:46.541078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:46.541863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.542210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.542553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.543550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] RBAC: Adding query filter params (role.id=830a10d3893c4f1ba36a2145058dfac3, user.id=c6860d92114941a095b44e7c8d8442ec, scope.system=all) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:46.543927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:46.546406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:46.559951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 192/369] 10.222.0.17 () {56 vars in 1308 bytes} [Thu Jul 14 11:03:46 2022] GET /identity/v3/role_assignments?user.id=c6860d92114941a095b44e7c8d8442ec&scope.system=all&role.id=830a10d3893c4f1ba36a2145058dfac3 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:46.561203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:46.583668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:46.584425 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a87475-7776-44e6-8927-b547246ecfb4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:46.625907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77a444-2dc3-46eb-9d56-7149ea8222cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:46.626999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77a444-2dc3-46eb-9d56-7149ea8222cf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.627557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77a444-2dc3-46eb-9d56-7149ea8222cf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.628048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77a444-2dc3-46eb-9d56-7149ea8222cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.688762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b3e0c-a803-4b67-a1c8-f80bb412655f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:46.711638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77a444-2dc3-46eb-9d56-7149ea8222cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:46.713238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77a444-2dc3-46eb-9d56-7149ea8222cf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:46.729417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:46.771755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aacf9e-f7ae-4c74-9308-ca535b27815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:46.772630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aacf9e-f7ae-4c74-9308-ca535b27815d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:46.772917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aacf9e-f7ae-4c74-9308-ca535b27815d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:46.773197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aacf9e-f7ae-4c74-9308-ca535b27815d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:46.798460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aacf9e-f7ae-4c74-9308-ca535b27815d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-44aacf9e-f7ae-4c74-9308-ca535b27815d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:46.806766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:46.807730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:46.809071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 193/370] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:46.809927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aacf9e-f7ae-4c74-9308-ca535b27815d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:46.894578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 178/371] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:46.895493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77a444-2dc3-46eb-9d56-7149ea8222cf None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:46.923704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:46.953267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aacf9e-f7ae-4c74-9308-ca535b27815d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:47.001949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:47.002724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.002940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.003174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.004935 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] RBAC: Adding query filter params (group.id=d569872336eb46bc80a4415023fec7cf, role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:47.005252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:47.007228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:47.018536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 194/372] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:46 2022] GET /identity/v3/role_assignments?group.id=d569872336eb46bc80a4415023fec7cf&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:47.021177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:47.059336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77a444-2dc3-46eb-9d56-7149ea8222cf None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:47.074355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:47.125771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:47.126870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.128521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.129052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.133223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:47.133820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:47.135446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:47.148787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 179/373] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:47.157917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:47.205933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96045-0ae0-4e44-b6c2-318907523956 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:47.268661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d34017-5401-414b-b579-287aea78a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:47.269333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d34017-5401-414b-b579-287aea78a925 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.269620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d34017-5401-414b-b579-287aea78a925 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.270058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d34017-5401-414b-b579-287aea78a925 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.271960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d34017-5401-414b-b579-287aea78a925 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:47.273692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d34017-5401-414b-b579-287aea78a925 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:47.275476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 195/374] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:47 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:47.276886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fa8b0-5a1c-4541-906a-c3b4e0272d7e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.278188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fa8b0-5a1c-4541-906a-c3b4e0272d7e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.278474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fa8b0-5a1c-4541-906a-c3b4e0272d7e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.280667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 196/375] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:47.285227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fa8b0-5a1c-4541-906a-c3b4e0272d7e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:47.293962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906ee3f-88d8-4b4d-b60f-d11759d92ace None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:47.300080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:47.339871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1932d2-63a9-472b-8345-d2a28237126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:47.340731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1932d2-63a9-472b-8345-d2a28237126f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.341016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1932d2-63a9-472b-8345-d2a28237126f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.341294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1932d2-63a9-472b-8345-d2a28237126f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.391976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:47.402508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fa8b0-5a1c-4541-906a-c3b4e0272d7e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:47.423372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1932d2-63a9-472b-8345-d2a28237126f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:47.425024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1932d2-63a9-472b-8345-d2a28237126f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:47.441461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56412287-7e0b-4e68-a451-fab8de2f3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:47.442350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412287-7e0b-4e68-a451-fab8de2f3e58 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.442640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412287-7e0b-4e68-a451-fab8de2f3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.442912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56412287-7e0b-4e68-a451-fab8de2f3e58 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.444249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412287-7e0b-4e68-a451-fab8de2f3e58 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:47.445683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56412287-7e0b-4e68-a451-fab8de2f3e58 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:47.448041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 197/376] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:47 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:47.450487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884240cf-402e-4164-bd50-ec43d2000da0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.450487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884240cf-402e-4164-bd50-ec43d2000da0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.450487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884240cf-402e-4164-bd50-ec43d2000da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.468600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-884240cf-402e-4164-bd50-ec43d2000da0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:47.469921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-884240cf-402e-4164-bd50-ec43d2000da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:47.577637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 198/377] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:47.578539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884240cf-402e-4164-bd50-ec43d2000da0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:47.591254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:47.620003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 180/378] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:47.621314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1932d2-63a9-472b-8345-d2a28237126f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:47.717742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884240cf-402e-4164-bd50-ec43d2000da0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:47.723566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:47.760656 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:47.761650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.763090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.763529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.764662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] RBAC: Adding query filter params (group.id=d569872336eb46bc80a4415023fec7cf, role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:47.765127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:47.766285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1932d2-63a9-472b-8345-d2a28237126f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:47.767053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:47.773801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 199/379] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:47 2022] GET /identity/v3/role_assignments?group.id=d569872336eb46bc80a4415023fec7cf&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:47.775539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:47.812314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827b69c-57e8-4814-84cb-92c598e69a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:47.813418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827b69c-57e8-4814-84cb-92c598e69a0d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.813847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827b69c-57e8-4814-84cb-92c598e69a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.814258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827b69c-57e8-4814-84cb-92c598e69a0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.827753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827b69c-57e8-4814-84cb-92c598e69a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3827b69c-57e8-4814-84cb-92c598e69a0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:47.838687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:47.839864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:47.840873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:47.843082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 181/380] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:47.849216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827b69c-57e8-4814-84cb-92c598e69a0d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:47.866969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:47.913268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d3c4d-c55b-4d4c-b61a-348491b2e329 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:47.957704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04760d5-3de8-4860-99ea-edb109cd2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:47.958617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04760d5-3de8-4860-99ea-edb109cd2652 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:47.958902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04760d5-3de8-4860-99ea-edb109cd2652 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:47.959181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04760d5-3de8-4860-99ea-edb109cd2652 None admin] PATH_INFO: `/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:47.960754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04760d5-3de8-4860-99ea-edb109cd2652 None admin] RBAC: Authorizing `identity:get_project(project_id=5bd9aa1d8c77470b8cfa8dc04c19be52)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:47.962313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04760d5-3de8-4860-99ea-edb109cd2652 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:47.968257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 200/381] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:47 2022] GET /identity/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:47.972045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04760d5-3de8-4860-99ea-edb109cd2652 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:47.992536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827b69c-57e8-4814-84cb-92c598e69a0d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:48.031019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:48.038869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:48.039580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.039864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.040168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.040946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:48.041260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:48.042734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:48.053659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 182/382] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:48.059859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:48.101759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04760d5-3de8-4860-99ea-edb109cd2652 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:48.159282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f79bb6-2c7a-46fc-ad35-1f6ee9fb5874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:48.160198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79bb6-2c7a-46fc-ad35-1f6ee9fb5874 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.160487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79bb6-2c7a-46fc-ad35-1f6ee9fb5874 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.160765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79bb6-2c7a-46fc-ad35-1f6ee9fb5874 None admin] PATH_INFO: `/v3/groups/010890c2ccfb4af692137373e03672ef` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.168238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f79bb6-2c7a-46fc-ad35-1f6ee9fb5874 None admin] RBAC: Authorizing `identity:get_group(group_id=010890c2ccfb4af692137373e03672ef)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:48.169928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f79bb6-2c7a-46fc-ad35-1f6ee9fb5874 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:48.176195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 201/383] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:47 2022] GET /identity/v3/groups/010890c2ccfb4af692137373e03672ef => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:48.177936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbab2-91f6-4719-9c79-b0c4a9816fa7 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.178457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbab2-91f6-4719-9c79-b0c4a9816fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.178939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bbab2-91f6-4719-9c79-b0c4a9816fa7 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.181591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 202/384] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:48.182868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bbab2-91f6-4719-9c79-b0c4a9816fa7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:48.193381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:48.195111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5cdb6-43f1-46ec-93ce-5b2dc10cb788 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:48.247288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d7e3f-bf2c-4b62-93ba-6df2ce0cb5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:48.248237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7e3f-bf2c-4b62-93ba-6df2ce0cb5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.248533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7e3f-bf2c-4b62-93ba-6df2ce0cb5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.248809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d7e3f-bf2c-4b62-93ba-6df2ce0cb5b6 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.250998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d7e3f-bf2c-4b62-93ba-6df2ce0cb5b6 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:48.252773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d7e3f-bf2c-4b62-93ba-6df2ce0cb5b6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:48.255688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 183/385] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:48 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:48.257022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65faf-03e7-42e2-b8e5-5af41d046374 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.257315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65faf-03e7-42e2-b8e5-5af41d046374 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.257594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d65faf-03e7-42e2-b8e5-5af41d046374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.280724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-01d65faf-03e7-42e2-b8e5-5af41d046374 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:48.281966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-01d65faf-03e7-42e2-b8e5-5af41d046374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:48.332969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bbab2-91f6-4719-9c79-b0c4a9816fa7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:48.357269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:48.381765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 184/386] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:48.382855 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65faf-03e7-42e2-b8e5-5af41d046374 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:48.384245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:48.385006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.385356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.385745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.386659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] RBAC: Adding query filter params (group.id=010890c2ccfb4af692137373e03672ef, role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=5bd9aa1d8c77470b8cfa8dc04c19be52) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:48.387039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:48.389729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:48.395812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 203/387] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:48 2022] GET /identity/v3/role_assignments?group.id=010890c2ccfb4af692137373e03672ef&scope.project.id=5bd9aa1d8c77470b8cfa8dc04c19be52&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:48.415007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:48.546024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d65faf-03e7-42e2-b8e5-5af41d046374 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:48.585785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:48.622331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b090b7-fc56-4925-97aa-7434f869ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:48.623168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b090b7-fc56-4925-97aa-7434f869ed6a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.623484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b090b7-fc56-4925-97aa-7434f869ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.623759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b090b7-fc56-4925-97aa-7434f869ed6a None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.626237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b090b7-fc56-4925-97aa-7434f869ed6a None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:48.627767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b090b7-fc56-4925-97aa-7434f869ed6a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:48.629842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 185/388] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:48 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:48.637652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b090b7-fc56-4925-97aa-7434f869ed6a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:48.649180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fbf79-0858-40bd-87ea-1139fd3e0d5c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:48.721073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:48.726645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0dfe-7429-4dac-8dca-59622414ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:48.727492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0dfe-7429-4dac-8dca-59622414ff08 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.727810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0dfe-7429-4dac-8dca-59622414ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.728028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0dfe-7429-4dac-8dca-59622414ff08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.760760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b0dfe-7429-4dac-8dca-59622414ff08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:48.768609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b090b7-fc56-4925-97aa-7434f869ed6a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-620b0dfe-7429-4dac-8dca-59622414ff08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:48.769567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:48.770430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:48.771240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 204/389] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:48.776779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0dfe-7429-4dac-8dca-59622414ff08 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:48.844895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ee18e-7258-44e0-9dcd-52fa069ac24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:48.845804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee18e-7258-44e0-9dcd-52fa069ac24a None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.846082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee18e-7258-44e0-9dcd-52fa069ac24a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.846356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ee18e-7258-44e0-9dcd-52fa069ac24a None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/groups/d569872336eb46bc80a4415023fec7cf/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.848607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ee18e-7258-44e0-9dcd-52fa069ac24a None admin] RBAC: Authorizing `identity:create_grant(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc, group_id=d569872336eb46bc80a4415023fec7cf, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:48.850073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ee18e-7258-44e0-9dcd-52fa069ac24a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:48.891402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 186/390] 10.222.0.17 () {58 vars in 1442 bytes} [Thu Jul 14 11:03:48 2022] PUT /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/groups/d569872336eb46bc80a4415023fec7cf/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:48.903853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0dfe-7429-4dac-8dca-59622414ff08 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:48.936782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:48.946211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:48.947164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:48.947632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:48.948055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:48.948972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:48.949472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:48.951054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:48.961329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 205/391] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:48.966513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ee18e-7258-44e0-9dcd-52fa069ac24a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:49.075189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ee18e-7258-44e0-9dcd-52fa069ac24a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:49.099959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:49.117315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a070b1-2f04-47ec-95cf-2d20aeda8828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:49.118197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a070b1-2f04-47ec-95cf-2d20aeda8828 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:49.118880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a070b1-2f04-47ec-95cf-2d20aeda8828 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:49.119566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a070b1-2f04-47ec-95cf-2d20aeda8828 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:49.120961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a070b1-2f04-47ec-95cf-2d20aeda8828 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:49.122494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a070b1-2f04-47ec-95cf-2d20aeda8828 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:49.125038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 187/392] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:48 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:49.133236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:49.248999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02533f1-f939-434f-8589-e8ecf34a71b8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:49.284200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e7013-2505-48f4-acb8-618d201ad53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:49.285088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7013-2505-48f4-acb8-618d201ad53e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:49.285370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7013-2505-48f4-acb8-618d201ad53e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:49.285639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e7013-2505-48f4-acb8-618d201ad53e None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:49.286817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7013-2505-48f4-acb8-618d201ad53e None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:49.288303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e7013-2505-48f4-acb8-618d201ad53e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:49.290340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 206/393] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:49 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:49.296223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a070b1-2f04-47ec-95cf-2d20aeda8828 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:49.403331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a070b1-2f04-47ec-95cf-2d20aeda8828 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:49.441775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd85fc4-07c2-4dd9-8960-4849146d515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:49.442667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd85fc4-07c2-4dd9-8960-4849146d515d None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:49.442944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd85fc4-07c2-4dd9-8960-4849146d515d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:49.443213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd85fc4-07c2-4dd9-8960-4849146d515d None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/groups/d569872336eb46bc80a4415023fec7cf/roles/9189b2de997c4913bc3d3b88754b8966` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:49.445524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd85fc4-07c2-4dd9-8960-4849146d515d None admin] RBAC: Authorizing `identity:create_grant(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc, group_id=d569872336eb46bc80a4415023fec7cf, role_id=9189b2de997c4913bc3d3b88754b8966)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:49.446984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd85fc4-07c2-4dd9-8960-4849146d515d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:49.461676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 188/394] 10.222.0.17 () {58 vars in 1442 bytes} [Thu Jul 14 11:03:49 2022] PUT /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc/groups/d569872336eb46bc80a4415023fec7cf/roles/9189b2de997c4913bc3d3b88754b8966 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:03:49.716625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504581-9c1b-4f06-84f4-189300341bd2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:49.717540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504581-9c1b-4f06-84f4-189300341bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:49.717721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02504581-9c1b-4f06-84f4-189300341bd2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:49.719349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 207/395] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:49.726137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f8b5f-aaaf-4022-b0b4-56b464349d48 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:49.726428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f8b5f-aaaf-4022-b0b4-56b464349d48 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:49.726703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f8b5f-aaaf-4022-b0b4-56b464349d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:49.744177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-580f8b5f-aaaf-4022-b0b4-56b464349d48 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:49.745381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-580f8b5f-aaaf-4022-b0b4-56b464349d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:49.791047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:49.815442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 189/396] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:49.837747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02504581-9c1b-4f06-84f4-189300341bd2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:49.900340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:49.949951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02504581-9c1b-4f06-84f4-189300341bd2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:49.987405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4e9f4-6cd6-4c5f-8566-95fd01d35463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:49.988258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4e9f4-6cd6-4c5f-8566-95fd01d35463 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:49.988547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4e9f4-6cd6-4c5f-8566-95fd01d35463 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:49.988823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4e9f4-6cd6-4c5f-8566-95fd01d35463 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:49.999637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4e9f4-6cd6-4c5f-8566-95fd01d35463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3ff4e9f4-6cd6-4c5f-8566-95fd01d35463 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:50.007440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:50.008362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:50.009161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 208/397] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:50.015088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f8b5f-aaaf-4022-b0b4-56b464349d48 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:50.118172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f8b5f-aaaf-4022-b0b4-56b464349d48 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:50.154183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:50.155459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:50.155742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:50.156014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:50.156791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:50.157091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:50.158472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:50.167539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 190/398] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:50.173248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4e9f4-6cd6-4c5f-8566-95fd01d35463 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:50.281908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4e9f4-6cd6-4c5f-8566-95fd01d35463 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:50.304428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:50.316623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f899-b627-4ccf-a530-cb4debda96e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:50.317487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f899-b627-4ccf-a530-cb4debda96e8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:50.317770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f899-b627-4ccf-a530-cb4debda96e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:50.318044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3f899-b627-4ccf-a530-cb4debda96e8 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:50.319222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3f899-b627-4ccf-a530-cb4debda96e8 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:50.320716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3f899-b627-4ccf-a530-cb4debda96e8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:50.328551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:50.339994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 209/399] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:50 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:50.371491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:50.430802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a406b-2206-4562-bfc8-38f442b3c485 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:50.465305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fbb2f-a950-4714-9e61-cbde379773a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:50.466185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbb2f-a950-4714-9e61-cbde379773a8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:50.466464 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbb2f-a950-4714-9e61-cbde379773a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:50.466790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fbb2f-a950-4714-9e61-cbde379773a8 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:50.468611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fbb2f-a950-4714-9e61-cbde379773a8 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:50.470580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fbb2f-a950-4714-9e61-cbde379773a8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:50.473226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 191/400] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:50 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:50.479811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f899-b627-4ccf-a530-cb4debda96e8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:50.643062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3f899-b627-4ccf-a530-cb4debda96e8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:50.687909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4430b58-71c7-4f1c-8220-17c9e067fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:50.688829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4430b58-71c7-4f1c-8220-17c9e067fe93 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:50.689115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4430b58-71c7-4f1c-8220-17c9e067fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:50.689394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4430b58-71c7-4f1c-8220-17c9e067fe93 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/groups/d569872336eb46bc80a4415023fec7cf/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:50.691702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4430b58-71c7-4f1c-8220-17c9e067fe93 None admin] RBAC: Authorizing `identity:create_grant(project_id=6560cdd2158e448ea29d06c8dc4e7ddb, group_id=d569872336eb46bc80a4415023fec7cf, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:50.693260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4430b58-71c7-4f1c-8220-17c9e067fe93 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:50.718988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 210/401] 10.222.0.17 () {58 vars in 1442 bytes} [Thu Jul 14 11:03:50 2022] PUT /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/groups/d569872336eb46bc80a4415023fec7cf/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:03:50.777001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a726b-0d5e-4bd7-80bb-696b7e525852 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:50.777328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a726b-0d5e-4bd7-80bb-696b7e525852 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:50.777577 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a726b-0d5e-4bd7-80bb-696b7e525852 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:50.779432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 192/402] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:50.789797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607412-463c-4446-9b15-35ef3ea86a43 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:50.790104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607412-463c-4446-9b15-35ef3ea86a43 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:50.790360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e607412-463c-4446-9b15-35ef3ea86a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:50.813203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4e607412-463c-4446-9b15-35ef3ea86a43 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:50.814409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4e607412-463c-4446-9b15-35ef3ea86a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:50.882555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:50.916457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 211/403] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:50.950812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a726b-0d5e-4bd7-80bb-696b7e525852 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:51.075017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a726b-0d5e-4bd7-80bb-696b7e525852 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:51.086559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:51.116601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ac26-e01c-4ec5-98c1-8d66aa23ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:51.117418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ac26-e01c-4ec5-98c1-8d66aa23ac8f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:51.117696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ac26-e01c-4ec5-98c1-8d66aa23ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:51.117970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ac26-e01c-4ec5-98c1-8d66aa23ac8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:51.131360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00ac26-e01c-4ec5-98c1-8d66aa23ac8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ee00ac26-e01c-4ec5-98c1-8d66aa23ac8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:51.141290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:51.142569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:51.143392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 193/404] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:51.148714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607412-463c-4446-9b15-35ef3ea86a43 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:51.276833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e607412-463c-4446-9b15-35ef3ea86a43 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:51.322457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63082-f3c6-4f64-85bb-d73825922f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:51.323521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63082-f3c6-4f64-85bb-d73825922f2d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:51.324000 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63082-f3c6-4f64-85bb-d73825922f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:51.324607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63082-f3c6-4f64-85bb-d73825922f2d None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:51.325684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63082-f3c6-4f64-85bb-d73825922f2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:51.326207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63082-f3c6-4f64-85bb-d73825922f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:51.328546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63082-f3c6-4f64-85bb-d73825922f2d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:51.343810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 212/405] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:51.349277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ac26-e01c-4ec5-98c1-8d66aa23ac8f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:51.482407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18085e-770e-4df6-9e50-c5db24e40c74 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:51.483586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18085e-770e-4df6-9e50-c5db24e40c74 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:51.484088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18085e-770e-4df6-9e50-c5db24e40c74 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:51.486045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 213/406] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:51.490135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00ac26-e01c-4ec5-98c1-8d66aa23ac8f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:51.491626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c20b8-963a-481f-b4c3-96c91443a49a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:51.492135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c20b8-963a-481f-b4c3-96c91443a49a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:51.492704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c20b8-963a-481f-b4c3-96c91443a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:51.527739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a821f-3d1a-40f1-b199-3c25a831dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:51.529207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-958c20b8-963a-481f-b4c3-96c91443a49a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:51.530682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-958c20b8-963a-481f-b4c3-96c91443a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:51.530904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a821f-3d1a-40f1-b199-3c25a831dad8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:51.531203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a821f-3d1a-40f1-b199-3c25a831dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:51.531490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a821f-3d1a-40f1-b199-3c25a831dad8 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:51.532810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a821f-3d1a-40f1-b199-3c25a831dad8 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:51.537164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a821f-3d1a-40f1-b199-3c25a831dad8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:51.537164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 194/407] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:51 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:51.541434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a821f-3d1a-40f1-b199-3c25a831dad8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:51.596633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:51.598197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:51.628153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 214/408] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:51.650409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c20b8-963a-481f-b4c3-96c91443a49a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:51.730329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a821f-3d1a-40f1-b199-3c25a831dad8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:51.768319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c20b8-963a-481f-b4c3-96c91443a49a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:51.805506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d73f5-aca2-4fd5-8d75-3f38565d046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:51.806306 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d73f5-aca2-4fd5-8d75-3f38565d046d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:51.806598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d73f5-aca2-4fd5-8d75-3f38565d046d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:51.806886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d73f5-aca2-4fd5-8d75-3f38565d046d None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:51.808097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d73f5-aca2-4fd5-8d75-3f38565d046d None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:51.812282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164bac0-81ba-4391-bc1f-5106283a67b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:51.813082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164bac0-81ba-4391-bc1f-5106283a67b0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:51.813368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164bac0-81ba-4391-bc1f-5106283a67b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:51.813647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164bac0-81ba-4391-bc1f-5106283a67b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:51.817103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d73f5-aca2-4fd5-8d75-3f38565d046d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:51.818852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 195/409] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:51 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:51.825082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d73f5-aca2-4fd5-8d75-3f38565d046d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:51.844141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164bac0-81ba-4391-bc1f-5106283a67b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-d164bac0-81ba-4391-bc1f-5106283a67b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:51.852065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:51.852979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:51.853801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:51.861875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 215/410] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:51.862755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164bac0-81ba-4391-bc1f-5106283a67b0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:51.924499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:51.961663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d73f5-aca2-4fd5-8d75-3f38565d046d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:51.965844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:52.007638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ba918-26b5-4b19-996b-6c04cfbf3acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:52.009376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba918-26b5-4b19-996b-6c04cfbf3acd None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.009814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba918-26b5-4b19-996b-6c04cfbf3acd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.010259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ba918-26b5-4b19-996b-6c04cfbf3acd None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/groups/d569872336eb46bc80a4415023fec7cf/roles/9189b2de997c4913bc3d3b88754b8966` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.011039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164bac0-81ba-4391-bc1f-5106283a67b0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:52.013016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ba918-26b5-4b19-996b-6c04cfbf3acd None admin] RBAC: Authorizing `identity:create_grant(project_id=6560cdd2158e448ea29d06c8dc4e7ddb, group_id=d569872336eb46bc80a4415023fec7cf, role_id=9189b2de997c4913bc3d3b88754b8966)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:52.015483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ba918-26b5-4b19-996b-6c04cfbf3acd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:52.033608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 196/411] 10.222.0.17 () {58 vars in 1442 bytes} [Thu Jul 14 11:03:51 2022] PUT /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb/groups/d569872336eb46bc80a4415023fec7cf/roles/9189b2de997c4913bc3d3b88754b8966 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:52.035148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f95bbd-702c-44d8-bf22-4b802d5c724c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.035606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f95bbd-702c-44d8-bf22-4b802d5c724c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.036020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f95bbd-702c-44d8-bf22-4b802d5c724c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.037937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 197/412] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:52.043622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436633f9-c5d5-4bbb-8bae-a175b0c238d3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.044026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436633f9-c5d5-4bbb-8bae-a175b0c238d3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.044424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436633f9-c5d5-4bbb-8bae-a175b0c238d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.060242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:52.061194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.061629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.062074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.062988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:52.063446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:52.065024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:52.076049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 216/413] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:52.076542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-436633f9-c5d5-4bbb-8bae-a175b0c238d3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:52.077879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-436633f9-c5d5-4bbb-8bae-a175b0c238d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:52.081186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:52.203889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:52.216595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2543c-3fad-4f7e-a3b6-e2ee33b38bf6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:52.257428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5955-3772-4b49-b4e4-172b3fdd55d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:52.258839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5955-3772-4b49-b4e4-172b3fdd55d5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.259364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5955-3772-4b49-b4e4-172b3fdd55d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.259837 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee5955-3772-4b49-b4e4-172b3fdd55d5 None admin] PATH_INFO: `/v3/groups/010890c2ccfb4af692137373e03672ef` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.261398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5955-3772-4b49-b4e4-172b3fdd55d5 None admin] RBAC: Authorizing `identity:get_group(group_id=010890c2ccfb4af692137373e03672ef)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:52.263196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee5955-3772-4b49-b4e4-172b3fdd55d5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:52.266498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 217/414] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:52 2022] GET /identity/v3/groups/010890c2ccfb4af692137373e03672ef => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:52.278443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5955-3772-4b49-b4e4-172b3fdd55d5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:52.296354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 198/415] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:52.319858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436633f9-c5d5-4bbb-8bae-a175b0c238d3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:52.414099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee5955-3772-4b49-b4e4-172b3fdd55d5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:52.465091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:52.473263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41312be6-4164-4e04-a3b5-56954c55914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:52.474475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312be6-4164-4e04-a3b5-56954c55914c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.474995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312be6-4164-4e04-a3b5-56954c55914c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.475099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436633f9-c5d5-4bbb-8bae-a175b0c238d3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:52.475595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312be6-4164-4e04-a3b5-56954c55914c None admin] PATH_INFO: `/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.477848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41312be6-4164-4e04-a3b5-56954c55914c None admin] RBAC: Authorizing `identity:get_project(project_id=5bd9aa1d8c77470b8cfa8dc04c19be52)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:52.480411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41312be6-4164-4e04-a3b5-56954c55914c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:52.487162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 218/416] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:52 2022] GET /identity/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:52.487162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525fbbc-022b-4bd7-9c53-c2887d370ead None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.487162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525fbbc-022b-4bd7-9c53-c2887d370ead None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.487162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525fbbc-022b-4bd7-9c53-c2887d370ead None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.488141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 219/417] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:52.490550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525fbbc-022b-4bd7-9c53-c2887d370ead None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:52.528024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70b9ea-0713-4513-86b5-d7f38285fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:52.528905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70b9ea-0713-4513-86b5-d7f38285fd78 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.529187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70b9ea-0713-4513-86b5-d7f38285fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.530073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70b9ea-0713-4513-86b5-d7f38285fd78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.538061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:52.543018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70b9ea-0713-4513-86b5-d7f38285fd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7b70b9ea-0713-4513-86b5-d7f38285fd78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:52.555416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:52.557238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 199/418] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:52.558892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234b951-f6c0-4eca-bc99-65863ea1b41e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.568967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234b951-f6c0-4eca-bc99-65863ea1b41e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.568967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234b951-f6c0-4eca-bc99-65863ea1b41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.586933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f234b951-f6c0-4eca-bc99-65863ea1b41e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:52.589003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f234b951-f6c0-4eca-bc99-65863ea1b41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:52.650475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525fbbc-022b-4bd7-9c53-c2887d370ead None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:52.678021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 200/419] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:52.678947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234b951-f6c0-4eca-bc99-65863ea1b41e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:52.692240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ccc63-703e-4d02-a319-0742b5672221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:52.697356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ccc63-703e-4d02-a319-0742b5672221 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.698265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ccc63-703e-4d02-a319-0742b5672221 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.698737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ccc63-703e-4d02-a319-0742b5672221 None admin] PATH_INFO: `/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52/groups/010890c2ccfb4af692137373e03672ef/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.703488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ccc63-703e-4d02-a319-0742b5672221 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bd9aa1d8c77470b8cfa8dc04c19be52, group_id=010890c2ccfb4af692137373e03672ef, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:52.705378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ccc63-703e-4d02-a319-0742b5672221 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:52.728200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 220/420] 10.222.0.17 () {58 vars in 1442 bytes} [Thu Jul 14 11:03:52 2022] PUT /identity/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52/groups/010890c2ccfb4af692137373e03672ef/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:03:52.729600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ccc63-703e-4d02-a319-0742b5672221 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:52.854579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:52.889404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234b951-f6c0-4eca-bc99-65863ea1b41e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:52.905347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:52.934978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ccc63-703e-4d02-a319-0742b5672221 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:52.965443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:52.967029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.967784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.968289 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.969907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] RBAC: Adding query filter params (name=member) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:52.970547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:52.972561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:52.984041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3a9c0-92bc-4939-91dd-094eb212e599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:52.984911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a9c0-92bc-4939-91dd-094eb212e599 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:52.985238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a9c0-92bc-4939-91dd-094eb212e599 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:52.985467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3a9c0-92bc-4939-91dd-094eb212e599 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:52.985846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 201/421] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:52.991492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:53.001972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3a9c0-92bc-4939-91dd-094eb212e599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-b7e3a9c0-92bc-4939-91dd-094eb212e599 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:53.010598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:53.011512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:53.012367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:03:53.015123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 221/422] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:53.024043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3a9c0-92bc-4939-91dd-094eb212e599 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:53.132863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3a9c0-92bc-4939-91dd-094eb212e599 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:53.139596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edef66d-5567-4425-9ab1-6ba90aff5104 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:53.168971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:53.170624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.171437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.171954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:53.172938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:53.173437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:53.175188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:53.185098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 222/423] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:53.195025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:53.205022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4a7ce-4c8f-4eb3-b86b-0a37e442a88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:53.205700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a7ce-4c8f-4eb3-b86b-0a37e442a88c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.205984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a7ce-4c8f-4eb3-b86b-0a37e442a88c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.206259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4a7ce-4c8f-4eb3-b86b-0a37e442a88c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:53.220544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:53.242313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:53.320884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826520-726e-47ba-b53d-5eb944dbd897 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:53.321548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4a7ce-4c8f-4eb3-b86b-0a37e442a88c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:53.324174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4a7ce-4c8f-4eb3-b86b-0a37e442a88c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:53.362287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416425c8-ce2b-42a8-9c87-6950316b18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:53.362934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416425c8-ce2b-42a8-9c87-6950316b18f2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.363219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416425c8-ce2b-42a8-9c87-6950316b18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.363489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416425c8-ce2b-42a8-9c87-6950316b18f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:53.438461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416425c8-ce2b-42a8-9c87-6950316b18f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:53.439880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416425c8-ce2b-42a8-9c87-6950316b18f2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:53.451271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:53.462646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 202/424] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:53.462646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed78d9-0016-49dd-9f2a-ce79cdbc23f2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.462646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed78d9-0016-49dd-9f2a-ce79cdbc23f2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.462646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed78d9-0016-49dd-9f2a-ce79cdbc23f2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:53.464557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 203/425] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:53.466283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed78d9-0016-49dd-9f2a-ce79cdbc23f2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:53.537614 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:53.575055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 223/426] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:53.576824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27f43-6975-4abc-9c6a-808941282129 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.577316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27f43-6975-4abc-9c6a-808941282129 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.577794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27f43-6975-4abc-9c6a-808941282129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:53.601149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-aea27f43-6975-4abc-9c6a-808941282129 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:53.603446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-aea27f43-6975-4abc-9c6a-808941282129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:53.606033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed78d9-0016-49dd-9f2a-ce79cdbc23f2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:53.649180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd2225-fbcc-4d51-86df-dca11a5741d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:53.650151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd2225-fbcc-4d51-86df-dca11a5741d5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.650489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd2225-fbcc-4d51-86df-dca11a5741d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.650880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd2225-fbcc-4d51-86df-dca11a5741d5 None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:53.652618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd2225-fbcc-4d51-86df-dca11a5741d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:53.653624 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd2225-fbcc-4d51-86df-dca11a5741d5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:53.656036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 204/427] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:53 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:53.656921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd2225-fbcc-4d51-86df-dca11a5741d5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:53.698731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 224/428] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:53.700459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27f43-6975-4abc-9c6a-808941282129 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:53.756505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:53.763211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd2225-fbcc-4d51-86df-dca11a5741d5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:53.780439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:53.803857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17a0e-63e6-4cb2-90d8-ca3f90c5347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:53.805315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17a0e-63e6-4cb2-90d8-ca3f90c5347e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.805315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17a0e-63e6-4cb2-90d8-ca3f90c5347e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.805527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17a0e-63e6-4cb2-90d8-ca3f90c5347e None admin] PATH_INFO: `/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:53.806772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17a0e-63e6-4cb2-90d8-ca3f90c5347e None admin] RBAC: Authorizing `identity:get_project(project_id=e7139c85e08a4ddeb5a661aa1f9c45dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:53.808441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17a0e-63e6-4cb2-90d8-ca3f90c5347e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:53.810659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 205/429] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:53 2022] GET /identity/v3/projects/e7139c85e08a4ddeb5a661aa1f9c45dc => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:53.811548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17a0e-63e6-4cb2-90d8-ca3f90c5347e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:53.837674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27f43-6975-4abc-9c6a-808941282129 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:53.883011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138c976-46f3-467f-b3f6-802a021bad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:53.884002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c976-46f3-467f-b3f6-802a021bad04 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.884362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c976-46f3-467f-b3f6-802a021bad04 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.884904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138c976-46f3-467f-b3f6-802a021bad04 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:53.885970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138c976-46f3-467f-b3f6-802a021bad04 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:53.887462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138c976-46f3-467f-b3f6-802a021bad04 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:53.889759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 225/430] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:53 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:53.890812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138c976-46f3-467f-b3f6-802a021bad04 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:53.936632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17a0e-63e6-4cb2-90d8-ca3f90c5347e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:53.982234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861330-f7e6-4a6b-b3a3-466f8240daf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:53.983782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861330-f7e6-4a6b-b3a3-466f8240daf0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:53.984662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861330-f7e6-4a6b-b3a3-466f8240daf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:53.985315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861330-f7e6-4a6b-b3a3-466f8240daf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.000468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b861330-f7e6-4a6b-b3a3-466f8240daf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:54.006627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138c976-46f3-467f-b3f6-802a021bad04 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3b861330-f7e6-4a6b-b3a3-466f8240daf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:54.010758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:54.011654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:54.012738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 206/431] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:54.015257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861330-f7e6-4a6b-b3a3-466f8240daf0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:54.021638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:54.057556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99682-a12b-453e-b67d-7e378d9f95c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:54.058657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99682-a12b-453e-b67d-7e378d9f95c6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.059080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99682-a12b-453e-b67d-7e378d9f95c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.059514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99682-a12b-453e-b67d-7e378d9f95c6 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.061951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99682-a12b-453e-b67d-7e378d9f95c6 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:54.064007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99682-a12b-453e-b67d-7e378d9f95c6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:54.066687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 226/432] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:53 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:54.068285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99682-a12b-453e-b67d-7e378d9f95c6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:54.071527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:54.126768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861330-f7e6-4a6b-b3a3-466f8240daf0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:54.163884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:54.164900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.165326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.165745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.166738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] RBAC: Adding query filter params (group.id=d569872336eb46bc80a4415023fec7cf, role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:54.167203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:54.168837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:54.175694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 207/433] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:54 2022] GET /identity/v3/role_assignments?group.id=d569872336eb46bc80a4415023fec7cf&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:54.176861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:54.213490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99682-a12b-453e-b67d-7e378d9f95c6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:54.277176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:54.277779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.278066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.278345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.279116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:54.280046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:54.281733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:54.292669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 227/434] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:03:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:54.298518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:54.351840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:54.352534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89fd1-3a1a-4aa2-8a3a-5cdc15e9943c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:54.360483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:54.390833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0510c9d-9de2-4a0f-bff3-2585868bc663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:54.391497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510c9d-9de2-4a0f-bff3-2585868bc663 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.391787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510c9d-9de2-4a0f-bff3-2585868bc663 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.392059 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0510c9d-9de2-4a0f-bff3-2585868bc663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.392975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0510c9d-9de2-4a0f-bff3-2585868bc663 None admin] RBAC: Adding query filter params (group.id=d569872336eb46bc80a4415023fec7cf, role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:54.393288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0510c9d-9de2-4a0f-bff3-2585868bc663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:54.394740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0510c9d-9de2-4a0f-bff3-2585868bc663 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:54.402647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 208/435] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:54 2022] GET /identity/v3/role_assignments?group.id=d569872336eb46bc80a4415023fec7cf&scope.project.id=e7139c85e08a4ddeb5a661aa1f9c45dc&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:54.403900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0728-88f4-403d-aea7-9d37ace4f140 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.404211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0728-88f4-403d-aea7-9d37ace4f140 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.404524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d0728-88f4-403d-aea7-9d37ace4f140 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.405782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 209/436] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:54.414370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9ff7-4484-4aa2-9340-507ee9a0de77 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.414675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9ff7-4484-4aa2-9340-507ee9a0de77 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.415040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9ff7-4484-4aa2-9340-507ee9a0de77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.428864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64f119-41c8-46a1-8775-772be911e809 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:54.446493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-772b9ff7-4484-4aa2-9340-507ee9a0de77 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:54.448215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-772b9ff7-4484-4aa2-9340-507ee9a0de77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:54.469667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a8de2-1dbc-4824-b1c0-fa2086ad493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:54.470629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8de2-1dbc-4824-b1c0-fa2086ad493c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.471064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8de2-1dbc-4824-b1c0-fa2086ad493c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.471489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a8de2-1dbc-4824-b1c0-fa2086ad493c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.559116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 210/437] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:54.570979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a8de2-1dbc-4824-b1c0-fa2086ad493c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:54.570979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a8de2-1dbc-4824-b1c0-fa2086ad493c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:54.597204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b9ff7-4484-4aa2-9340-507ee9a0de77 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:54.613225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:54.707023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 228/438] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:03:54.712512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a8de2-1dbc-4824-b1c0-fa2086ad493c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:54.728728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:54.733532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b9ff7-4484-4aa2-9340-507ee9a0de77 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:54.778348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431c02-8c30-4186-9e98-351bf737a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:54.779954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431c02-8c30-4186-9e98-351bf737a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.780406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431c02-8c30-4186-9e98-351bf737a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.780942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431c02-8c30-4186-9e98-351bf737a6a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.791991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8431c02-8c30-4186-9e98-351bf737a6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b8431c02-8c30-4186-9e98-351bf737a6a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:54.800788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:54.801900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:03:54.802873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:54.805238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 211/439] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:03:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:54.812424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431c02-8c30-4186-9e98-351bf737a6a9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:54.838061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a8de2-1dbc-4824-b1c0-fa2086ad493c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:54.886130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155691c-415a-4fe3-a113-27719e94e6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:54.887250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155691c-415a-4fe3-a113-27719e94e6ac None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.887539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155691c-415a-4fe3-a113-27719e94e6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.888076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155691c-415a-4fe3-a113-27719e94e6ac None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.891463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155691c-415a-4fe3-a113-27719e94e6ac None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:54.893460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155691c-415a-4fe3-a113-27719e94e6ac None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:54.895813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 229/440] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:54 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:54.903232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155691c-415a-4fe3-a113-27719e94e6ac None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:54.908490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:54.948268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431c02-8c30-4186-9e98-351bf737a6a9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:54.994091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:54.995387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:54.995675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:54.995957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:54.996765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:54.997094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:54.999336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.008078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 212/441] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:03:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:55.014547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:55.032515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155691c-415a-4fe3-a113-27719e94e6ac None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.041451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:55.073566 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd946fcc-990a-4c95-97ab-5c6692366f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.074350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946fcc-990a-4c95-97ab-5c6692366f3d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.074636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946fcc-990a-4c95-97ab-5c6692366f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.074912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd946fcc-990a-4c95-97ab-5c6692366f3d None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.076858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd946fcc-990a-4c95-97ab-5c6692366f3d None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:55.078158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd946fcc-990a-4c95-97ab-5c6692366f3d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.080015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 230/442] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:54 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:55.085507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd946fcc-990a-4c95-97ab-5c6692366f3d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:55.124687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e96ead-c3b2-45e4-8861-c8799eb6894e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.161244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:55.165420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b6e0-ce01-4aad-8c85-ba4bbe09cb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.166200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b6e0-ce01-4aad-8c85-ba4bbe09cb51 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.166671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b6e0-ce01-4aad-8c85-ba4bbe09cb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.167113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7b6e0-ce01-4aad-8c85-ba4bbe09cb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.197934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd946fcc-990a-4c95-97ab-5c6692366f3d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.236556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc598f81-6501-47e7-8746-c29ac0b3abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.237218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc598f81-6501-47e7-8746-c29ac0b3abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.237506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc598f81-6501-47e7-8746-c29ac0b3abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.237799 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc598f81-6501-47e7-8746-c29ac0b3abc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.238640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc598f81-6501-47e7-8746-c29ac0b3abc3 None admin] RBAC: Adding query filter params (group.id=d569872336eb46bc80a4415023fec7cf, role.id=3c87a6985254480b960b2a9ddfc5d7cc, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:55.238957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc598f81-6501-47e7-8746-c29ac0b3abc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:55.240424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc598f81-6501-47e7-8746-c29ac0b3abc3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.244714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7b6e0-ce01-4aad-8c85-ba4bbe09cb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:55.246108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 231/443] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:55 2022] GET /identity/v3/role_assignments?group.id=d569872336eb46bc80a4415023fec7cf&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=3c87a6985254480b960b2a9ddfc5d7cc => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:55.246216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7b6e0-ce01-4aad-8c85-ba4bbe09cb51 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.247320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70801acf-0fbf-4586-8d6d-3849216359d8 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.247617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70801acf-0fbf-4586-8d6d-3849216359d8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.247902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70801acf-0fbf-4586-8d6d-3849216359d8 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.249800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 232/444] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:55.255374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edac8a-9fcb-4d00-8c49-43a6a6bacb4c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.255663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edac8a-9fcb-4d00-8c49-43a6a6bacb4c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.255941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edac8a-9fcb-4d00-8c49-43a6a6bacb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.273072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:55.275345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e8edac8a-9fcb-4d00-8c49-43a6a6bacb4c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:55.276639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e8edac8a-9fcb-4d00-8c49-43a6a6bacb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:55.356443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 233/445] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:55.371136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 213/446] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:03:55.377526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edac8a-9fcb-4d00-8c49-43a6a6bacb4c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:55.382710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b6e0-ce01-4aad-8c85-ba4bbe09cb51 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:55.453654 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:55.499868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7b6e0-ce01-4aad-8c85-ba4bbe09cb51 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.507239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edac8a-9fcb-4d00-8c49-43a6a6bacb4c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.527332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:55.546599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f57690-c99e-47e8-b5c9-9a041146acda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.547506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f57690-c99e-47e8-b5c9-9a041146acda None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.547794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f57690-c99e-47e8-b5c9-9a041146acda None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.548069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f57690-c99e-47e8-b5c9-9a041146acda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.553857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cb016-7708-4fe4-b596-d9c0c98e7df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.555062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cb016-7708-4fe4-b596-d9c0c98e7df7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.555515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cb016-7708-4fe4-b596-d9c0c98e7df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.555798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cb016-7708-4fe4-b596-d9c0c98e7df7 None admin] PATH_INFO: `/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.557312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cb016-7708-4fe4-b596-d9c0c98e7df7 None admin] RBAC: Authorizing `identity:get_project(project_id=6560cdd2158e448ea29d06c8dc4e7ddb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:55.558812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7cb016-7708-4fe4-b596-d9c0c98e7df7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.558944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f57690-c99e-47e8-b5c9-9a041146acda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:03:55.560811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 234/447] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:55 2022] GET /identity/v3/projects/6560cdd2158e448ea29d06c8dc4e7ddb => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:55.565988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cb016-7708-4fe4-b596-d9c0c98e7df7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-99f57690-c99e-47e8-b5c9-9a041146acda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:03:55.567234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:55.568213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:55.569033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 214/448] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:03:55.574758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f57690-c99e-47e8-b5c9-9a041146acda None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:55.676762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cb016-7708-4fe4-b596-d9c0c98e7df7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.678117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f57690-c99e-47e8-b5c9-9a041146acda None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.710136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e7195-3b7c-466e-8fad-ce930da0ccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.710992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e7195-3b7c-466e-8fad-ce930da0ccd3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.711275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e7195-3b7c-466e-8fad-ce930da0ccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.711552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e7195-3b7c-466e-8fad-ce930da0ccd3 None admin] PATH_INFO: `/v3/groups/d569872336eb46bc80a4415023fec7cf` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.711923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.712627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.712739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e7195-3b7c-466e-8fad-ce930da0ccd3 None admin] RBAC: Authorizing `identity:get_group(group_id=d569872336eb46bc80a4415023fec7cf)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:55.712907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.713179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.713914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:55.714182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e7195-3b7c-466e-8fad-ce930da0ccd3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.714278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:55.715564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.715956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 235/449] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:55 2022] GET /identity/v3/groups/d569872336eb46bc80a4415023fec7cf => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:55.721985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e7195-3b7c-466e-8fad-ce930da0ccd3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:55.728548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 215/450] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:55.729710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:55.731083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:55.774302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:55.819841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e7195-3b7c-466e-8fad-ce930da0ccd3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.828082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4ff4e-7530-4d45-a0c4-043f9c0fd455 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:55.852895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.853550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.853833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.854113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.854949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] RBAC: Adding query filter params (group.id=d569872336eb46bc80a4415023fec7cf, role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:55.855270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:55.856742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.863075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 236/451] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:55 2022] GET /identity/v3/role_assignments?group.id=d569872336eb46bc80a4415023fec7cf&scope.project.id=6560cdd2158e448ea29d06c8dc4e7ddb&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:03:55.863198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24736d0-056a-4cef-9d3e-dbbc4bae134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:55.863745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24736d0-056a-4cef-9d3e-dbbc4bae134f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:55.864032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24736d0-056a-4cef-9d3e-dbbc4bae134f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:55.864340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24736d0-056a-4cef-9d3e-dbbc4bae134f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:55.937160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24736d0-056a-4cef-9d3e-dbbc4bae134f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:55.938563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24736d0-056a-4cef-9d3e-dbbc4bae134f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:55.985951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:56.046959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 216/452] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:03:56.053424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:56.120316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:56.164164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfb858-6ac1-429f-8b9a-9113c795a097 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:56.204990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5104733-4fe1-4b96-b40b-efb569316d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:56.205802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104733-4fe1-4b96-b40b-efb569316d0a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:56.206084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104733-4fe1-4b96-b40b-efb569316d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:56.206355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5104733-4fe1-4b96-b40b-efb569316d0a None admin] PATH_INFO: `/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:56.207826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5104733-4fe1-4b96-b40b-efb569316d0a None admin] RBAC: Authorizing `identity:get_project(project_id=5bd9aa1d8c77470b8cfa8dc04c19be52)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:56.209168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5104733-4fe1-4b96-b40b-efb569316d0a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:56.211011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 237/453] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:03:56 2022] GET /identity/v3/projects/5bd9aa1d8c77470b8cfa8dc04c19be52 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:56.217892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24736d0-056a-4cef-9d3e-dbbc4bae134f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:56.315534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24736d0-056a-4cef-9d3e-dbbc4bae134f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:56.351910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bbe37-f7fe-478d-ac73-6a2af368372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:56.352806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bbe37-f7fe-478d-ac73-6a2af368372b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:56.353090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bbe37-f7fe-478d-ac73-6a2af368372b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:56.353367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bbe37-f7fe-478d-ac73-6a2af368372b None admin] PATH_INFO: `/v3/groups/010890c2ccfb4af692137373e03672ef` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:56.354581 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bbe37-f7fe-478d-ac73-6a2af368372b None admin] RBAC: Authorizing `identity:get_group(group_id=010890c2ccfb4af692137373e03672ef)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:56.356042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bbe37-f7fe-478d-ac73-6a2af368372b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:56.357889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 217/454] 10.222.0.17 () {56 vars in 1180 bytes} [Thu Jul 14 11:03:56 2022] GET /identity/v3/groups/010890c2ccfb4af692137373e03672ef => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:56.363643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5104733-4fe1-4b96-b40b-efb569316d0a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:56.478297 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5104733-4fe1-4b96-b40b-efb569316d0a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:56.514789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f74a8-c31f-4597-ad65-c47de17bf3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:56.515844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f74a8-c31f-4597-ad65-c47de17bf3ef None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:56.516175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f74a8-c31f-4597-ad65-c47de17bf3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:56.516472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f74a8-c31f-4597-ad65-c47de17bf3ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:56.517639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f74a8-c31f-4597-ad65-c47de17bf3ef None admin] RBAC: Adding query filter params (group.id=010890c2ccfb4af692137373e03672ef, role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=5bd9aa1d8c77470b8cfa8dc04c19be52) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:56.518084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f74a8-c31f-4597-ad65-c47de17bf3ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:56.519806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f74a8-c31f-4597-ad65-c47de17bf3ef None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:56.521907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:56.527291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 238/455] 10.222.0.17 () {56 vars in 1376 bytes} [Thu Jul 14 11:03:56 2022] GET /identity/v3/role_assignments?group.id=010890c2ccfb4af692137373e03672ef&scope.project.id=5bd9aa1d8c77470b8cfa8dc04c19be52&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:58.996069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5d33-687d-4c9f-a5e3-6f5716550097 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:58.997096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5d33-687d-4c9f-a5e3-6f5716550097 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:58.997591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5d33-687d-4c9f-a5e3-6f5716550097 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:58.999938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 218/456] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:03:59.005575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84aec-597d-40c4-8864-19180a677b62 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.006393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84aec-597d-40c4-8864-19180a677b62 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.006865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce84aec-597d-40c4-8864-19180a677b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.033083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4ce84aec-597d-40c4-8864-19180a677b62 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:59.034606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4ce84aec-597d-40c4-8864-19180a677b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:59.126526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 239/457] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:03:59.151290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab5d33-687d-4c9f-a5e3-6f5716550097 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:59.166699 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:59.253509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067ae3-f571-4e10-8cad-a6e88532ce30 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.253806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067ae3-f571-4e10-8cad-a6e88532ce30 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.253987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20067ae3-f571-4e10-8cad-a6e88532ce30 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.255518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 240/458] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:59.260534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78329-5d8c-44d0-8421-34ad9106608d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.260828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78329-5d8c-44d0-8421-34ad9106608d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.261108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78329-5d8c-44d0-8421-34ad9106608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.262833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab5d33-687d-4c9f-a5e3-6f5716550097 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:59.296759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c8c78329-5d8c-44d0-8421-34ad9106608d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:59.298179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c8c78329-5d8c-44d0-8421-34ad9106608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:59.302634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:59.303611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.308194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.308637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.324129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:59.325803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:03:59.354862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:59.356068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:59.357152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:03:59.357152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:03:59.357152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:03:59.357152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:59.367010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 219/459] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:59.376301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:59.437897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 241/460] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:59.445175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:59.453705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5ee2-9937-43d4-8146-16fb89ff9ea5 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.454332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5ee2-9937-43d4-8146-16fb89ff9ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.454832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd5ee2-9937-43d4-8146-16fb89ff9ea5 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.457660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 242/461] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:03:59.463189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca969-6fa1-49c1-94b1-8b4258241ef4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.463949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca969-6fa1-49c1-94b1-8b4258241ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.464502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ca969-6fa1-49c1-94b1-8b4258241ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.486103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-de2ca969-6fa1-49c1-94b1-8b4258241ef4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:03:59.487499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-de2ca969-6fa1-49c1-94b1-8b4258241ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:03:59.493445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9e47d-cbb7-4e1b-9bb2-b2311cbccd44 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:59.533830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:59.534504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.534788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.535062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.535902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:59.536237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:59.537741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:59.551211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 220/462] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:59.552070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:59.557386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:59.578253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 243/463] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:03:59.579309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca969-6fa1-49c1-94b1-8b4258241ef4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:59.668687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93d95-89e0-48dd-a690-8b634e9baa8d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:59.685877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ca969-6fa1-49c1-94b1-8b4258241ef4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:59.693296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:59.705736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:59.706732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.707084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.707422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.719510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:59.721072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:59.724531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2986f-1e81-422c-84ac-e4d370fd9932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:59.725267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2986f-1e81-422c-84ac-e4d370fd9932 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.725671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2986f-1e81-422c-84ac-e4d370fd9932 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.726010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2986f-1e81-422c-84ac-e4d370fd9932 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.726788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2986f-1e81-422c-84ac-e4d370fd9932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:59.728424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2986f-1e81-422c-84ac-e4d370fd9932 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:03:59.740179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:59.741724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:03:59.743924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:03:59.743924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:03:59.743924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:03:59.743924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:03:59.743924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 221/464] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:03:59.743924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:59.756532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 244/465] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:59 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:03:59.757423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2986f-1e81-422c-84ac-e4d370fd9932 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:59.813884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:03:59.869346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2986f-1e81-422c-84ac-e4d370fd9932 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:59.908497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:59.909202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.909560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.909856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.910703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:03:59.911010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:59.912638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:59.915160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243541-bace-4989-b116-3af7f7bd3b90 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:03:59.932658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 245/466] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:03:59.938350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:03:59.960192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88116d-79d6-4b91-8191-8968ef43bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:03:59.961112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88116d-79d6-4b91-8191-8968ef43bd3f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:03:59.961394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88116d-79d6-4b91-8191-8968ef43bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:03:59.961667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88116d-79d6-4b91-8191-8968ef43bd3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:03:59.975572 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88116d-79d6-4b91-8191-8968ef43bd3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:03:59.977103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88116d-79d6-4b91-8191-8968ef43bd3f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ce88116d-79d6-4b91-8191-8968ef43bd3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:03:59.996456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:03:59.999026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:00.001101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:00.001101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:00.001101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:00.001101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:00.001101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 222/467] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:00.001101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334aa1fe-f286-49d8-af00-5e01726f4bb2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.001101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334aa1fe-f286-49d8-af00-5e01726f4bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.001101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334aa1fe-f286-49d8-af00-5e01726f4bb2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.002145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 223/468] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:00.006695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334aa1fe-f286-49d8-af00-5e01726f4bb2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:00.038728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:00.057748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e4a2-f132-4666-b1ca-694e02981372 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:00.061571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:00.111509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9403a-840a-46ff-84d4-a290f59ebe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:00.112852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9403a-840a-46ff-84d4-a290f59ebe13 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.113334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9403a-840a-46ff-84d4-a290f59ebe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.114083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9403a-840a-46ff-84d4-a290f59ebe13 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.115411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9403a-840a-46ff-84d4-a290f59ebe13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:00.117151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9403a-840a-46ff-84d4-a290f59ebe13 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:00.134105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334aa1fe-f286-49d8-af00-5e01726f4bb2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:00.146923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 246/469] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:03:59 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:00.150594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185076-5f6f-4c51-90f9-81c168519402 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.151230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185076-5f6f-4c51-90f9-81c168519402 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.151709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48185076-5f6f-4c51-90f9-81c168519402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.174487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-48185076-5f6f-4c51-90f9-81c168519402 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:00.176873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-48185076-5f6f-4c51-90f9-81c168519402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:00.194825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:00.196143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.197398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.198055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.200593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:00.201799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:00.208936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:00.222297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 224/470] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:00.228042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:00.327745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:00.345119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28afc7-fee8-452c-b7c4-b4ee54f2dd19 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:00.353699 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 247/471] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:00.382884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e6d6-9187-411a-95ca-788ecc8ee599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:00.383481 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e6d6-9187-411a-95ca-788ecc8ee599 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.383764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e6d6-9187-411a-95ca-788ecc8ee599 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.384039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422e6d6-9187-411a-95ca-788ecc8ee599 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.384804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422e6d6-9187-411a-95ca-788ecc8ee599 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:00.386247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422e6d6-9187-411a-95ca-788ecc8ee599 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:00.390110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48185076-5f6f-4c51-90f9-81c168519402 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:00.411198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 225/472] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:04:00 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:04:00.521921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:00.536922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48185076-5f6f-4c51-90f9-81c168519402 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:00.577548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90b85-cb26-4bb2-9075-2857e4dc9b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:00.578369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90b85-cb26-4bb2-9075-2857e4dc9b09 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.578649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90b85-cb26-4bb2-9075-2857e4dc9b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.578922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90b85-cb26-4bb2-9075-2857e4dc9b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.590597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d90b85-cb26-4bb2-9075-2857e4dc9b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:00.592175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d90b85-cb26-4bb2-9075-2857e4dc9b09 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c3d90b85-cb26-4bb2-9075-2857e4dc9b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:00.615537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:00.624160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:00.625073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:00.625073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:00.625073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:00.625073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:00.625073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 248/473] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:00.625357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e6d6-9187-411a-95ca-788ecc8ee599 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:00.688612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e77c-c9ef-4bc1-9aa7-68130c912452 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.688895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e77c-c9ef-4bc1-9aa7-68130c912452 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.689080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e77c-c9ef-4bc1-9aa7-68130c912452 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.690684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 249/474] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:04:00.696606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc56594-6035-4898-a46a-d42a9cd5c209 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.696890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc56594-6035-4898-a46a-d42a9cd5c209 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.697167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc56594-6035-4898-a46a-d42a9cd5c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.714763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7dc56594-6035-4898-a46a-d42a9cd5c209 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:00.716400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7dc56594-6035-4898-a46a-d42a9cd5c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:00.745533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422e6d6-9187-411a-95ca-788ecc8ee599 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:00.793398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:00.794350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.794642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.795487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.796951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:00.797268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:00.799191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:00.804282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 250/475] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:00.813173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 226/476] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:00.818470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc56594-6035-4898-a46a-d42a9cd5c209 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:00.833159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:00.837005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:00.914988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:00.951644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc56594-6035-4898-a46a-d42a9cd5c209 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:00.973740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3820c-1ab7-4db4-a542-2f0b4388b9f3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:00.991124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ba42-8fad-4cbc-936a-21d5a1401d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:00.992289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ba42-8fad-4cbc-936a-21d5a1401d42 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:00.992871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ba42-8fad-4cbc-936a-21d5a1401d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:00.993384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4ba42-8fad-4cbc-936a-21d5a1401d42 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:00.994312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ba42-8fad-4cbc-936a-21d5a1401d42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:00.996236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4ba42-8fad-4cbc-936a-21d5a1401d42 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:01.017861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:01.018556 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:01.018756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:01.019088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:01.019856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:01.021329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:01.024776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 251/477] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:04:00 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:01.031474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.sql.core [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 11:04:01.031474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 11:04:01.031474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [parameters: {'id': '0d54c806febb4a20be29b69dc63960b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 11:04:01.031474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80333) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jul 14 11:04:01.050226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:04:01.051707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application yield resource Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise self.value Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application session.commit() Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 11:04:01.053029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.flush() Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application compat.raise_( Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 11:04:01.053862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:04:01.054720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:04:01.055530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [parameters: {'id': '0d54c806febb4a20be29b69dc63960b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:01.056354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 11:04:01.057158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:01.057975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 227/478] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Jul 14 11:04:00 2022] POST /identity/v3/roles => generated 144 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:01.062803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ba42-8fad-4cbc-936a-21d5a1401d42 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:01.221172 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4ba42-8fad-4cbc-936a-21d5a1401d42 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:01.255211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:01.264554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26705799-6418-4f49-b3ae-4cb9b3e31f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:01.265411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705799-6418-4f49-b3ae-4cb9b3e31f79 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:01.266084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705799-6418-4f49-b3ae-4cb9b3e31f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:01.266373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26705799-6418-4f49-b3ae-4cb9b3e31f79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:01.277719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26705799-6418-4f49-b3ae-4cb9b3e31f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-26705799-6418-4f49-b3ae-4cb9b3e31f79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:01.286386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:01.287379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:01.288209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 252/479] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:01.295136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:01.368264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:01.406763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54758-6277-4c2c-a66b-40c46c7b289a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:01.442139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a737b0-624d-490a-baa1-7e9f613fffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:01.442810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a737b0-624d-490a-baa1-7e9f613fffbd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:01.443088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a737b0-624d-490a-baa1-7e9f613fffbd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:01.443360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a737b0-624d-490a-baa1-7e9f613fffbd None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:01.444272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a737b0-624d-490a-baa1-7e9f613fffbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:01.444589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a737b0-624d-490a-baa1-7e9f613fffbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:01.446046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a737b0-624d-490a-baa1-7e9f613fffbd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:01.454636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 228/480] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:02.231364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0ae1-64c6-4ba9-bfa7-2b335a025f65 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:02.231889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0ae1-64c6-4ba9-bfa7-2b335a025f65 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:02.232228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb0ae1-64c6-4ba9-bfa7-2b335a025f65 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:02.234004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 253/481] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:02.238814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b5fb9-87c4-4012-863e-357fa4fbb263 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:02.239229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b5fb9-87c4-4012-863e-357fa4fbb263 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:02.239365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b5fb9-87c4-4012-863e-357fa4fbb263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:02.265116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1e2b5fb9-87c4-4012-863e-357fa4fbb263 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:02.266307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1e2b5fb9-87c4-4012-863e-357fa4fbb263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:02.353465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 229/482] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:02.384453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb0ae1-64c6-4ba9-bfa7-2b335a025f65 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:02.528980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb0ae1-64c6-4ba9-bfa7-2b335a025f65 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:02.578604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0414a7f-6a16-4398-8cc2-a3c643af8e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:02.579463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0414a7f-6a16-4398-8cc2-a3c643af8e85 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:02.579756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0414a7f-6a16-4398-8cc2-a3c643af8e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:02.580036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0414a7f-6a16-4398-8cc2-a3c643af8e85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:02.594487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0414a7f-6a16-4398-8cc2-a3c643af8e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-d0414a7f-6a16-4398-8cc2-a3c643af8e85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:02.606374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:02.607859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:02.609289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 254/483] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:02.617194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b5fb9-87c4-4012-863e-357fa4fbb263 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:02.721177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:02.774742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b5fb9-87c4-4012-863e-357fa4fbb263 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:02.826204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088f6f2-48b4-4e14-abc0-8b12e9bc2683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:02.826800 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f6f2-48b4-4e14-abc0-8b12e9bc2683 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:02.827080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f6f2-48b4-4e14-abc0-8b12e9bc2683 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:02.827349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088f6f2-48b4-4e14-abc0-8b12e9bc2683 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:02.828091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088f6f2-48b4-4e14-abc0-8b12e9bc2683 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:02.828416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088f6f2-48b4-4e14-abc0-8b12e9bc2683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:02.829778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088f6f2-48b4-4e14-abc0-8b12e9bc2683 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:02.843698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 230/484] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:02.849116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0414a7f-6a16-4398-8cc2-a3c643af8e85 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:02.917978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfc462-a442-45e7-9e6f-5be8fde3e666 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:02.918377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfc462-a442-45e7-9e6f-5be8fde3e666 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:02.918561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfc462-a442-45e7-9e6f-5be8fde3e666 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:02.920716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 231/485] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:02.932456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:02.935058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b28d-d0c8-4dfa-aa4a-604375daaba9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:02.935659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b28d-d0c8-4dfa-aa4a-604375daaba9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:02.936033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b28d-d0c8-4dfa-aa4a-604375daaba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:02.972042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9f32b28d-d0c8-4dfa-aa4a-604375daaba9 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:02.973292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9f32b28d-d0c8-4dfa-aa4a-604375daaba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:03.010207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0414a7f-6a16-4398-8cc2-a3c643af8e85 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.056407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4128016-d458-415c-9551-32e2b992770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.057807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128016-d458-415c-9551-32e2b992770c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.058328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128016-d458-415c-9551-32e2b992770c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.058958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4128016-d458-415c-9551-32e2b992770c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.071706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 232/486] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:03.083978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4128016-d458-415c-9551-32e2b992770c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:03.085519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4128016-d458-415c-9551-32e2b992770c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:03.095502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32b28d-d0c8-4dfa-aa4a-604375daaba9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f4128016-d458-415c-9551-32e2b992770c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:03.136145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:03.137071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:03.138587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:03.138587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:03.138587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:03.138587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:03.138587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 255/487] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:03.145339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4128016-d458-415c-9551-32e2b992770c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.174433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:03.223175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32b28d-d0c8-4dfa-aa4a-604375daaba9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.263771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61d253-bad2-4091-a490-adf283c2fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.264603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61d253-bad2-4091-a490-adf283c2fa85 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.264893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61d253-bad2-4091-a490-adf283c2fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.265226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61d253-bad2-4091-a490-adf283c2fa85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.279754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61d253-bad2-4091-a490-adf283c2fa85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:03.280972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:03.284792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4128016-d458-415c-9551-32e2b992770c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ec61d253-bad2-4091-a490-adf283c2fa85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:03.291439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:03.292403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:03.293228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 233/488] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:03.297334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca5f61-9429-4999-b7ff-8de89c157d46 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.297841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca5f61-9429-4999-b7ff-8de89c157d46 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.298356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca5f61-9429-4999-b7ff-8de89c157d46 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.299913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 234/489] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:03.304136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca5f61-9429-4999-b7ff-8de89c157d46 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.332890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abd9ea-af2d-49d7-8b5b-da2733b3172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.333910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd9ea-af2d-49d7-8b5b-da2733b3172c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.334462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd9ea-af2d-49d7-8b5b-da2733b3172c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.334945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abd9ea-af2d-49d7-8b5b-da2733b3172c None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.335894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd9ea-af2d-49d7-8b5b-da2733b3172c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:03.336448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd9ea-af2d-49d7-8b5b-da2733b3172c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:03.338064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51abd9ea-af2d-49d7-8b5b-da2733b3172c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:03.353065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 256/490] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:03.354639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a311-d20c-4b8a-8860-1d4cbb69bef4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.355133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a311-d20c-4b8a-8860-1d4cbb69bef4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.355641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a311-d20c-4b8a-8860-1d4cbb69bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.373743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2de6a311-d20c-4b8a-8860-1d4cbb69bef4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:03.375429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2de6a311-d20c-4b8a-8860-1d4cbb69bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:03.411225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca5f61-9429-4999-b7ff-8de89c157d46 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.424943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:03.447288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.447992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.448325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.448583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.449465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:03.449697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:03.451559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:03.460423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 257/492] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:03.461581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a311-d20c-4b8a-8860-1d4cbb69bef4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.464528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 235/492] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:03.466203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.570408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6655d-af6b-4e1a-ae63-ac0260c2ae3c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.594116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:03.605492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.606290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a311-d20c-4b8a-8860-1d4cbb69bef4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.606426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.606608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.606841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.619948 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:03.621476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:03.641358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:03.642266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:03.643133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:03.643133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:03.643133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:03.643133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:03.647190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 236/493] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:03.648063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.649146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.650230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.650753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.651316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.660400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:03.662377 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:03.677604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:03.681680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:03.682586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:03.683540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:03.687168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 258/494] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:03.688339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.758133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61338b97-4ab2-42c5-b896-ad5693e7c98c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.793581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e0e42-e3a9-4662-a19e-a0df41ae23f3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.795952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a19047-a995-46ae-b3a2-4ce277c5690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.797121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a19047-a995-46ae-b3a2-4ce277c5690c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.797234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a19047-a995-46ae-b3a2-4ce277c5690c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.797430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a19047-a995-46ae-b3a2-4ce277c5690c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.808466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a19047-a995-46ae-b3a2-4ce277c5690c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-62a19047-a995-46ae-b3a2-4ce277c5690c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:03.817507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:03.818447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:03.819262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:03.823547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 237/495] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:03.824524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a19047-a995-46ae-b3a2-4ce277c5690c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.834734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.835728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.836267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.836752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.837687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:03.838219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:03.839836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:03.852612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 259/496] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:03.853746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:03.866507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:03.925901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:03.945301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a19047-a995-46ae-b3a2-4ce277c5690c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.961790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e9989-c0cd-4789-9a4e-4fd82dc01186 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:03.992130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f58d3-6e28-46fa-81f0-3e986173a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:03.992130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f58d3-6e28-46fa-81f0-3e986173a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:03.992130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f58d3-6e28-46fa-81f0-3e986173a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:03.992130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f58d3-6e28-46fa-81f0-3e986173a0d2 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:03.992545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f58d3-6e28-46fa-81f0-3e986173a0d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:03.992545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f58d3-6e28-46fa-81f0-3e986173a0d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:03.992545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f58d3-6e28-46fa-81f0-3e986173a0d2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:03.999680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.000445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.000726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.001004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.001992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:04.002295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:04.003732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:04.012889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 260/497] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:04.014364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.032335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 238/498] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:04:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:04.033669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b873d-e5e1-4cc6-8286-d7bd7b50ee65 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.033954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b873d-e5e1-4cc6-8286-d7bd7b50ee65 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.034236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b873d-e5e1-4cc6-8286-d7bd7b50ee65 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.035602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 239/499] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:04.036605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464d39-93bb-4ce0-a935-59a0f21c9549 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.036864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464d39-93bb-4ce0-a935-59a0f21c9549 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.037143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464d39-93bb-4ce0-a935-59a0f21c9549 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.038630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 240/500] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:04.039348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5464d39-93bb-4ce0-a935-59a0f21c9549 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.085813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:04.116178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11111e-0eb3-466e-a584-c743db1f7cce None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.141641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5464d39-93bb-4ce0-a935-59a0f21c9549 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.149438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.150242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.150631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.150812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] PATH_INFO: `/v3/users/glance` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.158086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:04.159561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:04.174053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:04.174973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:04.175873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 261/501] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:04.176489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.178402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1c9dd-7e01-4965-b5f2-ffb8a09ba0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.179375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c9dd-7e01-4965-b5f2-ffb8a09ba0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.179786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c9dd-7e01-4965-b5f2-ffb8a09ba0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.180070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c9dd-7e01-4965-b5f2-ffb8a09ba0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.191514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c9dd-7e01-4965-b5f2-ffb8a09ba0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:04.193025 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c9dd-7e01-4965-b5f2-ffb8a09ba0c0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:04.195682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-80d1c9dd-7e01-4965-b5f2-ffb8a09ba0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:04.212014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:04.212957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:04.213792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:04.213792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:04.213792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:04.213792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:04.213792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 241/502] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:04.218721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316305-e075-4386-9847-b6b3144f9978 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.218721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316305-e075-4386-9847-b6b3144f9978 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.218721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316305-e075-4386-9847-b6b3144f9978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.231756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-86316305-e075-4386-9847-b6b3144f9978 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:04.233525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-86316305-e075-4386-9847-b6b3144f9978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:04.285160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729d650-74a9-42d9-a13a-440c95df30ff None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.304571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 242/503] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:04.306027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0037-47ef-4692-8448-4f829591fe36 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.306320 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0037-47ef-4692-8448-4f829591fe36 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.306599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0037-47ef-4692-8448-4f829591fe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.316007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:04.324690 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5fd55-5d04-4450-b7c1-eb6ccac9058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.325349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5fd55-5d04-4450-b7c1-eb6ccac9058f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.325636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5fd55-5d04-4450-b7c1-eb6ccac9058f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.325915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5fd55-5d04-4450-b7c1-eb6ccac9058f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.326449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-977d0037-47ef-4692-8448-4f829591fe36 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:04.327652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-977d0037-47ef-4692-8448-4f829591fe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:04.394369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5fd55-5d04-4450-b7c1-eb6ccac9058f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:04.395774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5fd55-5d04-4450-b7c1-eb6ccac9058f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:04.396447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 243/504] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:04.397288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0037-47ef-4692-8448-4f829591fe36 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.454185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:04.498567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0037-47ef-4692-8448-4f829591fe36 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.505846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 262/505] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:04.506683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5fd55-5d04-4450-b7c1-eb6ccac9058f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.536459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.537132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.537415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.537690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.538302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:04.538529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:04.539258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:04.540756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:04.559015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 244/506] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:04.559835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.612620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5fd55-5d04-4450-b7c1-eb6ccac9058f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.644990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.645577 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.645860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.646137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.646859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:04.647169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:04.648586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:04.655871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4171e-33ae-4e50-ae7b-6ef46d70bafc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.660315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 263/507] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:04.661421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.676567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:04.705643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.706536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.706822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.707097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.717473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:04.718929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:04.736485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:04.737491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:04.738344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:04.738344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:04.738344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:04.738344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:04.738344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 245/508] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:04.738638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.763959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:04.772886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c276732-4027-463c-b25d-41b96ae215c7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.805845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1816-a157-471b-8511-66e2305e4080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.806640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1816-a157-471b-8511-66e2305e4080 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.806929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1816-a157-471b-8511-66e2305e4080 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.807217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c1816-a157-471b-8511-66e2305e4080 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.818189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c1816-a157-471b-8511-66e2305e4080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-724c1816-a157-471b-8511-66e2305e4080 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:04.826022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:04.826912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:04.827736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 264/509] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:04.828472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1816-a157-471b-8511-66e2305e4080 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.840744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317da59-ca4c-4ebb-b315-e74b4a982300 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.874605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.875450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.875670 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.875939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.885865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:04.887331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:04.906067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:04.906936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:04.907786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:04.907786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:04.907786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:04.907786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:04.907786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 246/510] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:04.908053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:04.926212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:04.931707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c1816-a157-471b-8511-66e2305e4080 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:04.964926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384629-daaf-49ed-bcf4-c377f0c51ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:04.965573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384629-daaf-49ed-bcf4-c377f0c51ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:04.965862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384629-daaf-49ed-bcf4-c377f0c51ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:04.966134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8384629-daaf-49ed-bcf4-c377f0c51ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:04.987318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.006211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40c8b1-3914-43d9-a344-0144107a9985 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.034914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8384629-daaf-49ed-bcf4-c377f0c51ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.036412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8384629-daaf-49ed-bcf4-c377f0c51ed1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.040975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.041774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.042062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.042340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.049393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.050842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:05.066586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:05.067503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 247/511] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:05.068676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.136663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 265/512] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:05.137504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384629-daaf-49ed-bcf4-c377f0c51ed1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.144681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.166851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed112d2c-1db2-4358-89c3-729c2282cd85 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.189350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.202445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.203113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.203390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.203674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.204438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:05.204739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.206132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.218351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 248/513] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:05.219173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.242253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8384629-daaf-49ed-bcf4-c377f0c51ed1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.275876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.276579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.276863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.277138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.279926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:05.279926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.280146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.288572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 266/514] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:05.289417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.318904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cb444-cbe6-4203-9821-2a22262ccf2b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.351909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.352606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.352888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.353167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.353888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:05.354187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.355596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.363224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.370117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 249/515] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:05.371043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.397401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982188ac-6475-46f8-8c85-356180c04829 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.411815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.432164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.432777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.433067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.433344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.434190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:05.434501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.436494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.472726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 267/516] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:05.473334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776b87d-406e-443a-8f88-aed658752559 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.473544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.508194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.508984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.509269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.509544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.521246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.522723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:05.541256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:05.542223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:05.543082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:05.543082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:05.543082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:05.543082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:05.543082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 250/517] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:05.543345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.576807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b6cdd-9282-4a44-9c84-489d934ae3ed None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.595576 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.610326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc5259-a6cd-4a6d-a926-bc258d0c19f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.610996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc5259-a6cd-4a6d-a926-bc258d0c19f6 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.611272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc5259-a6cd-4a6d-a926-bc258d0c19f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.611548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc5259-a6cd-4a6d-a926-bc258d0c19f6 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.612278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc5259-a6cd-4a6d-a926-bc258d0c19f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.613725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc5259-a6cd-4a6d-a926-bc258d0c19f6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.635220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 268/518] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:04:05 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:05.636178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc5259-a6cd-4a6d-a926-bc258d0c19f6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.647409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98221cc6-0afe-4d00-9e71-06099983927b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.680002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.689853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.690588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.690877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.691389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.703075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.704671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:05.723784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:05.724755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:05.725617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:05.725617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:05.725617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:05.725617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:05.725617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 251/519] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:05.725885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.769809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc5259-a6cd-4a6d-a926-bc258d0c19f6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.811991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.812888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.813171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.813450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.822013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.823491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:05.839889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:05.840996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:05.841961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:05.841961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:05.841961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:05.841961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:05.841961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:05.841961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:05.841961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:05.841961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:05.842388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9f003-61d4-4253-acb2-247d29461cac None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.842462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 269/520] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:05.842462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:05.848357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.879628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac3a7-0789-4baf-9094-cdcb766efa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.880707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac3a7-0789-4baf-9094-cdcb766efa0d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.880991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac3a7-0789-4baf-9094-cdcb766efa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.881265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac3a7-0789-4baf-9094-cdcb766efa0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.939831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:05.952135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276f36-1ae5-4d25-baf3-adb1d6400aa3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:05.963172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac3a7-0789-4baf-9094-cdcb766efa0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.964656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac3a7-0789-4baf-9094-cdcb766efa0d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:05.993108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:05.993936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:05.994220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:05.994497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:05.995226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:05.995530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:05.996949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.009570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 270/521] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:06.010409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.079284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 252/522] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:06.080286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac3a7-0789-4baf-9094-cdcb766efa0d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.082582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:06.122411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957d6e9-c89e-4ce1-98a1-2f1edcee84de None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.159054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.159753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.160033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.160337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.161061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:06.161365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.162747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.179832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 271/523] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:06.179832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.190083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:06.195286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac3a7-0789-4baf-9094-cdcb766efa0d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.233878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.234474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.234749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.235022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.235808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:06.236140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.237586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.261732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 253/524] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:06.261732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.297164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287d470-4f76-49cf-a9c3-f1633c35efe8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.335257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:06.346989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.347952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.348395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.348794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.357057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.359840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:06.374903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:06.375811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:06.376707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 272/525] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:06.377841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.382978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f34af8-bb9f-417e-862c-461dba669e35 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.419379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.420275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.420557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.420831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.432883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.434348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.447804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:06.453082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:06.453965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:06.454819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:06.454819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:06.454819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:06.454819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:06.454819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 254/526] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:06.455583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.487742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335015ec-a17d-49e3-b7a6-d0488f65d3e7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.523906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.524742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.525030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.525308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.533989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.535527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:06.549934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:06.550977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 273/527] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:06.551869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.574793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe57ce9-5292-4f1c-a1d3-7b398b1f013b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.589300 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:06.611581 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.612270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.612551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.612828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.613654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=00b59b80b61a4dec8f4df2bc8a45d340) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:06.613964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.615413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.621081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 255/528] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/role_assignments?user.id=00b59b80b61a4dec8f4df2bc8a45d340&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:06.621081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.671105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6f45-0acf-43ef-8332-0d039c1820b4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.718527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:06.729463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.730380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.730728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.731070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.732817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:06.733189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.735649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.755745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445089a-f24f-40fd-8af6-d3465a64873b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.764309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 274/529] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:06.765286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.816631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.817340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.817921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.818207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.818969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:06.819280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.820754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.838739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 256/530] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:06.838739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.890224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:06.895926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdd645-a9bf-4c3b-83b6-862e70005d87 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:06.939137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:06.940088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:06.940539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:06.940968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:06.942219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:06.942666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:06.944320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:06.962756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 275/531] 10.222.0.17 () {56 vars in 1139 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:06.963815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:06.971894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d67b-2b11-40fa-bad7-ba259eb0cf77 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:07.013721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:07.014644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:07.015149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:07.015564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:07.016563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=4c97bd14230147a5bd004c71f5387098) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:07.017011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:07.018660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:07.024672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 257/532] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/role_assignments?user.id=4c97bd14230147a5bd004c71f5387098&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:07.025618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:07.032496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:07.086046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e000d-12c3-48e8-afe2-7ae78e78b6ac None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:07.130247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:07.130247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:07.130247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:07.130247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:07.139391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:07.141144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:07.170433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:07.171539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:07.172984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:07.172984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:07.172984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:07.172984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:07.172984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:07.172984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:07.172984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:07.172984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:07.174949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 276/533] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:07.180476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:07.291002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d5f46-1497-49dc-af1d-7c4f46302c16 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:07.292547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:07.354675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1a5f-0816-4a83-93ef-b1f7bf666a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:07.355485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1a5f-0816-4a83-93ef-b1f7bf666a1b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:07.355675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1a5f-0816-4a83-93ef-b1f7bf666a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:07.355959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1a5f-0816-4a83-93ef-b1f7bf666a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:07.370408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4946cab-9ddb-4c66-b8a2-0cd07c1bc0ea None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:07.379545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:07.438244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:07.438918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:07.439206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:07.439491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:07.440326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:07.440644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:07.442370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:07.468633 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 277/534] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:07.474619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:07.492654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b1a5f-0816-4a83-93ef-b1f7bf666a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:07.494162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b1a5f-0816-4a83-93ef-b1f7bf666a1b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:07.619527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a75f5-bd0e-4895-a1dd-ae18b53bb919 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:07.656866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438288e-6205-41f4-8854-0443db706315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:07.657548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438288e-6205-41f4-8854-0443db706315 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:07.657838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438288e-6205-41f4-8854-0443db706315 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:07.658115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438288e-6205-41f4-8854-0443db706315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:07.659148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438288e-6205-41f4-8854-0443db706315 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=c46f7ca6d48c4124a9af1dc3a74c37a5) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:07.659465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438288e-6205-41f4-8854-0443db706315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:07.664129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438288e-6205-41f4-8854-0443db706315 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:07.668286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 278/535] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:07 2022] GET /identity/v3/role_assignments?user.id=c46f7ca6d48c4124a9af1dc3a74c37a5&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:07.720147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 258/536] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:07.725591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438288e-6205-41f4-8854-0443db706315 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:07.775833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:07.861687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524b81-2c67-4bc9-8057-48c876a83cf5 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:07.862339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524b81-2c67-4bc9-8057-48c876a83cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:07.862687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524b81-2c67-4bc9-8057-48c876a83cf5 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:07.864424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 259/537] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:04:07.875650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e98c-8439-4904-867f-baff088ad5ea None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:07.876255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e98c-8439-4904-867f-baff088ad5ea None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:07.876990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7e98c-8439-4904-867f-baff088ad5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:07.880394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438288e-6205-41f4-8854-0443db706315 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:07.886219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:07.903655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9ff7e98c-8439-4904-867f-baff088ad5ea None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:07.906248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9ff7e98c-8439-4904-867f-baff088ad5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:07.921763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:07.922579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:07.922922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:07.923200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:07.937179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:07.939075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:07.958067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:07.959010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:07.959947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:07.959947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:07.959947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:07.959947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:07.962423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 279/538] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:07.970844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:08.052412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 260/539] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:04:08.095401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:08.098198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7e98c-8439-4904-867f-baff088ad5ea None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:08.134442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621e64c-3870-48c0-bc2e-5e3d40219bd0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:08.173813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:08.174853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:08.175146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:08.175607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:08.176273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:08.176592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:08.178515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:08.202855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 280/540] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:08.208549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:08.228745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7e98c-8439-4904-867f-baff088ad5ea None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:08.263000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:08.277565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a188a-faeb-48ca-a10a-b9f72e5c5f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:08.278721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a188a-faeb-48ca-a10a-b9f72e5c5f0c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:08.279742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a188a-faeb-48ca-a10a-b9f72e5c5f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:08.284439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a188a-faeb-48ca-a10a-b9f72e5c5f0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:08.304997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a188a-faeb-48ca-a10a-b9f72e5c5f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b38a188a-faeb-48ca-a10a-b9f72e5c5f0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:08.313618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:08.314561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:08.315368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:08.318048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 261/541] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:08.328541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a188a-faeb-48ca-a10a-b9f72e5c5f0c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:08.489291 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a188a-faeb-48ca-a10a-b9f72e5c5f0c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:08.502204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d4463-c20b-4d4e-b9a2-c72856ba30b2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:08.548709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:08.549746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:08.550233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:08.550731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:08.551710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:08.552264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:08.555411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:08.571747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 262/542] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:08.579356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:08.628345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:08.629548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:08.630042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:08.630543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:08.649057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:08.650898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:08.676885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:08.677790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:08.678652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:08.678652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:08.678652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:08.678652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:08.678652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:08.678652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:08.678652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:08.678652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:08.684062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 281/543] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 476 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:08.685867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:08.687885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:08.695360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:08.767273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5defbb1-2675-490f-b316-8c60657eda0b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:08.811242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604ff91-45d6-4db1-9e16-87ebec7202a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:08.814559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ff91-45d6-4db1-9e16-87ebec7202a0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:08.815077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ff91-45d6-4db1-9e16-87ebec7202a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:08.815574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604ff91-45d6-4db1-9e16-87ebec7202a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:08.843174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604ff91-45d6-4db1-9e16-87ebec7202a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:08.847056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604ff91-45d6-4db1-9e16-87ebec7202a0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e604ff91-45d6-4db1-9e16-87ebec7202a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:08.890857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:08.891789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:08.892683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:08.892683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:08.892683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:08.892683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:08.892683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 263/544] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:08.900352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf15a8c-edd1-4e8b-8381-a33d98a912b2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:08.900639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf15a8c-edd1-4e8b-8381-a33d98a912b2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:08.900919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf15a8c-edd1-4e8b-8381-a33d98a912b2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:08.902420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 264/545] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:04:08.903639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf15a8c-edd1-4e8b-8381-a33d98a912b2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.016759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d01486-fc44-4b30-a0cb-3f78f8d92262 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.050119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf15a8c-edd1-4e8b-8381-a33d98a912b2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.058335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:09.060091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c40a86-30ce-4beb-8b52-423a5c6f4401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.061517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c40a86-30ce-4beb-8b52-423a5c6f4401 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.061857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c40a86-30ce-4beb-8b52-423a5c6f4401 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.062279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c40a86-30ce-4beb-8b52-423a5c6f4401 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.063096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c40a86-30ce-4beb-8b52-423a5c6f4401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:09.063422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c40a86-30ce-4beb-8b52-423a5c6f4401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:09.066060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c40a86-30ce-4beb-8b52-423a5c6f4401 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:09.084407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 282/546] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:09.086393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30c7a8-656f-4b10-861b-3bb7fd68d61f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.086691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30c7a8-656f-4b10-861b-3bb7fd68d61f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.087136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30c7a8-656f-4b10-861b-3bb7fd68d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.094899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.096009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.096560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.096844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.097588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:09.097899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:09.099285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:09.110382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cb30c7a8-656f-4b10-861b-3bb7fd68d61f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:09.111895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cb30c7a8-656f-4b10-861b-3bb7fd68d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:09.116461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 265/547] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:09.117359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.191586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:09.207766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 283/548] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:09.208922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30c7a8-656f-4b10-861b-3bb7fd68d61f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.252720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003b19-c7af-4749-af87-6210e38c09c6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.289433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.290192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.290604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.290907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.291899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=a367d904a4a44e91862da4aea28a123b) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:09.292321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:09.293828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:09.300672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 266/549] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:09 2022] GET /identity/v3/role_assignments?user.id=a367d904a4a44e91862da4aea28a123b&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:09.300978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.340014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:09.344946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30c7a8-656f-4b10-861b-3bb7fd68d61f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.385021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.386002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.386486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.386768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.396305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:09.397947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:09.414193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:09.415885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:09.417227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:09.418390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 284/550] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:09.424460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.441557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c6548-91e7-4cab-b392-52f755ff4b86 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.484438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1c49a-2f2a-432a-bdd9-ab77e1e79f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.486222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1c49a-2f2a-432a-bdd9-ab77e1e79f9a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.486825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1c49a-2f2a-432a-bdd9-ab77e1e79f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.487307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1c49a-2f2a-432a-bdd9-ab77e1e79f9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.501329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1c49a-2f2a-432a-bdd9-ab77e1e79f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1ef1c49a-2f2a-432a-bdd9-ab77e1e79f9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:09.511908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:09.512945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:09.513820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:09.517711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 267/551] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:09.529528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1c49a-2f2a-432a-bdd9-ab77e1e79f9a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.540137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:09.591144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aab25a-8631-498a-974c-bb8aef5665ee None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.630441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.631155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.631441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.631720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.632625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:09.632938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:09.634392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:09.649757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:09.655606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 285/552] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Jul 14 11:04:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:09.660784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1c49a-2f2a-432a-bdd9-ab77e1e79f9a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.661457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.697258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24712381-1677-4b73-b524-d2252405d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.697935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24712381-1677-4b73-b524-d2252405d28d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.698221 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24712381-1677-4b73-b524-d2252405d28d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.698497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24712381-1677-4b73-b524-d2252405d28d None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.699252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24712381-1677-4b73-b524-d2252405d28d None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:09.699563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24712381-1677-4b73-b524-d2252405d28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:09.701013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24712381-1677-4b73-b524-d2252405d28d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:09.710100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 268/553] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:09.718667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24712381-1677-4b73-b524-d2252405d28d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.796852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90f106-9b3b-4bd5-a6c6-46bf8fe39f87 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.810091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:09.838494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88696f2f-e0b2-4c56-97fc-d4b1a346745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.839416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696f2f-e0b2-4c56-97fc-d4b1a346745e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.839799 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696f2f-e0b2-4c56-97fc-d4b1a346745e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.840226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88696f2f-e0b2-4c56-97fc-d4b1a346745e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.867128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24712381-1677-4b73-b524-d2252405d28d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:09.911698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdad85-7a72-4055-a8e0-6f0612b67ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:09.912018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88696f2f-e0b2-4c56-97fc-d4b1a346745e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:09.912967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdad85-7a72-4055-a8e0-6f0612b67ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.913392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdad85-7a72-4055-a8e0-6f0612b67ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.913505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88696f2f-e0b2-4c56-97fc-d4b1a346745e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:09.913897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdad85-7a72-4055-a8e0-6f0612b67ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.929624 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdad85-7a72-4055-a8e0-6f0612b67ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:09.931825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdad85-7a72-4055-a8e0-6f0612b67ae0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6ebdad85-7a72-4055-a8e0-6f0612b67ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:09.954017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:09.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:09.955928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:09.955928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:09.955928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:09.955928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:09.960132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 269/554] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:09.961675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074b24e-327d-433b-8760-faaeef8b7888 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:09.961972 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074b24e-327d-433b-8760-faaeef8b7888 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:09.962254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074b24e-327d-433b-8760-faaeef8b7888 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:09.968199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 270/555] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:09.968199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074b24e-327d-433b-8760-faaeef8b7888 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:09.970182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:10.040581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 286/556] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:10.041913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb1cd-2550-4546-9422-1de787b23e79 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.042210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb1cd-2550-4546-9422-1de787b23e79 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.042494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35deb1cd-2550-4546-9422-1de787b23e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.063773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-35deb1cd-2550-4546-9422-1de787b23e79 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:10.065040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-35deb1cd-2550-4546-9422-1de787b23e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:10.069030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:10.094351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074b24e-327d-433b-8760-faaeef8b7888 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.131288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22911fff-61a3-4cfb-aa3b-eeebb3ff5ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.131865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911fff-61a3-4cfb-aa3b-eeebb3ff5ecd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.132173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911fff-61a3-4cfb-aa3b-eeebb3ff5ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.132450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22911fff-61a3-4cfb-aa3b-eeebb3ff5ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.133173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22911fff-61a3-4cfb-aa3b-eeebb3ff5ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:10.133477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22911fff-61a3-4cfb-aa3b-eeebb3ff5ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:10.134861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22911fff-61a3-4cfb-aa3b-eeebb3ff5ecd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:10.140073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 287/557] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:10.141142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deb1cd-2550-4546-9422-1de787b23e79 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.158408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 271/558] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:10.158408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b099b11-cf0c-4564-a8dd-810e23259800 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.158408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b099b11-cf0c-4564-a8dd-810e23259800 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.158408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b099b11-cf0c-4564-a8dd-810e23259800 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.158408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 272/559] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:10.159355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b099b11-cf0c-4564-a8dd-810e23259800 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.230797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:10.265695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35deb1cd-2550-4546-9422-1de787b23e79 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.275870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b099b11-cf0c-4564-a8dd-810e23259800 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.307852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.308703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.309206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.309361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.313726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223f983-66f1-48fc-8f87-d49de6de9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.314613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223f983-66f1-48fc-8f87-d49de6de9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.314894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223f983-66f1-48fc-8f87-d49de6de9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.315208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223f983-66f1-48fc-8f87-d49de6de9fe1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.318812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:10.321358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:10.322902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223f983-66f1-48fc-8f87-d49de6de9fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:10.323011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:10.324390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223f983-66f1-48fc-8f87-d49de6de9fe1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0223f983-66f1-48fc-8f87-d49de6de9fe1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:10.339531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:10.340544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:10.342143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 273/560] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:10.343279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979824c-852a-4489-806f-0b6a66c5ad28 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.343279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979824c-852a-4489-806f-0b6a66c5ad28 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.343516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979824c-852a-4489-806f-0b6a66c5ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:10.345401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:10.346276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:10.347239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:10.347239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:10.347239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:10.347239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:10.348934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 288/561] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:10.349848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.363034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e979824c-852a-4489-806f-0b6a66c5ad28 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:10.364280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e979824c-852a-4489-806f-0b6a66c5ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:10.435850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 274/562] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:10.437049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979824c-852a-4489-806f-0b6a66c5ad28 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.477299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6e62-2c13-4533-8ef9-53f9c4661caa None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.498778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:10.517873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982ef09-bfd6-42e3-b728-4cbbc6a12c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.518689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982ef09-bfd6-42e3-b728-4cbbc6a12c4b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.518978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982ef09-bfd6-42e3-b728-4cbbc6a12c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.519259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982ef09-bfd6-42e3-b728-4cbbc6a12c4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.533622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982ef09-bfd6-42e3-b728-4cbbc6a12c4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a982ef09-bfd6-42e3-b728-4cbbc6a12c4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:10.541711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:10.543362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 289/563] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:10.544249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982ef09-bfd6-42e3-b728-4cbbc6a12c4b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.561433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979824c-852a-4489-806f-0b6a66c5ad28 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.605499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.606220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.606500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.606801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.607268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:10.607688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:10.608374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:10.609902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:10.628733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 275/564] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:10.629875 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.662224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982ef09-bfd6-42e3-b728-4cbbc6a12c4b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.698069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.698687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.698945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.699225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.699987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:10.700298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:10.702302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:10.714305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 290/565] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:10.715044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.742113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ab3c-af78-48f3-8519-3ebf8df9916f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.758418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:10.783971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9fc9-63bd-4c20-92a2-904db33190f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.784805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9fc9-63bd-4c20-92a2-904db33190f6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.785083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9fc9-63bd-4c20-92a2-904db33190f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.785360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9fc9-63bd-4c20-92a2-904db33190f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.795578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e9fc9-63bd-4c20-92a2-904db33190f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-870e9fc9-63bd-4c20-92a2-904db33190f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:10.803285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:10.804286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:10.805145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 276/566] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:10.805833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9fc9-63bd-4c20-92a2-904db33190f6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.830600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4807a8-5d59-40b3-9fef-586818414401 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.844724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:10.871120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.871896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.872222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.872504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.873790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:10.874268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:10.876159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:10.884698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 291/567] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:10.885529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:10.918951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9fc9-63bd-4c20-92a2-904db33190f6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:10.958692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:10.959521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:10.959805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:10.960080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:10.971425 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:10.972939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:10.991547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:10.992522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:10.993457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:10.993457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:10.993457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:10.993457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:10.993457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 277/568] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:10.993756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.000571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d4758-41f7-4293-8e9c-c7f786994a0e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.022493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:11.035798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.036633 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.036923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.037200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.045853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.047322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:11.063030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:11.063954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:11.064909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 292/569] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:11.065390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.105558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:11.113662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021e25a-b26a-45b6-911c-09878ee8caad None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.152875 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.153547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.153831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.154134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.155004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:11.155187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.156601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.165270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 278/570] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:11.165977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.181532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fdb9-9821-499e-a281-354ae050777a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.223429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.224188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.224472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.224750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.235733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.237249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:11.256202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:11.257238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:11.258124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:11.258124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:11.258124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:11.258124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:11.258124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 293/571] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:11.259201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.260007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:11.280859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755de43-bb6d-432d-ab51-6e6c278c6dd3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.318873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.319705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.319817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.320077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.320828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:11.321155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.322505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.334901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 279/572] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:11.335777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.356320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:11.372677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07a4f1-3dbd-404d-a974-1532a8920e66 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.406523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.407187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.407471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.407749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.408659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:11.408976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.410417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.423284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 294/573] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:11.424025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.451672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e00bdf-f4f3-4f96-b70c-787edf92e682 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.490021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.490767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.491046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.491317 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.501865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.503329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.510949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:11.525231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:11.526346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:11.527449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:11.527449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:11.527449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:11.527449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:11.532037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 280/574] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:11.533421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.539038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec75c8-aa91-4069-8ca3-203bc806d80f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.574871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.575817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.576130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.576420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.577268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:11.577578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.578960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.590963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 295/575] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:11.592278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.605345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:11.642797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec11e-90b9-4a59-8b17-eb6cf61bf9e9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.676608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.677410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.677692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.677967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.684500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.686193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.696368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853de56-9ed0-452a-95cb-4886053f49e3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:11.700707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:11.702202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:11.703087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 281/576] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:11.703567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.733501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.734162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.734448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.734730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.735562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=23cd2e48acd9491cb513274c8ce3641f) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:11.735874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.737341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.742735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 296/577] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/role_assignments?user.id=23cd2e48acd9491cb513274c8ce3641f&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:11.743446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.763879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:11.812530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d81181-4207-4a14-8ccf-bcf84ddb8c21 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.841406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:11.855923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b701a-ade6-424c-9694-408c51d04797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.856638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b701a-ade6-424c-9694-408c51d04797 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.856932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b701a-ade6-424c-9694-408c51d04797 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.857249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b701a-ade6-424c-9694-408c51d04797 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.858331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b701a-ade6-424c-9694-408c51d04797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:11.858331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b701a-ade6-424c-9694-408c51d04797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.859701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b701a-ade6-424c-9694-408c51d04797 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.873861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 282/578] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:11.875344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc68b6-367b-43b9-8329-7dbc56b4ee80 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.875823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc68b6-367b-43b9-8329-7dbc56b4ee80 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.876203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc68b6-367b-43b9-8329-7dbc56b4ee80 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.880153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 283/579] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:11.880153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc68b6-367b-43b9-8329-7dbc56b4ee80 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.887212 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235eff37-fc74-4181-8a64-4e62712673e8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:11.924551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:11.925471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:11.925841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:11.926186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:11.934329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:11.935828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:11.950618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:11.952780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:04:11.953744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:11.956991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 297/580] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:11.957884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:11.992241 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc68b6-367b-43b9-8329-7dbc56b4ee80 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.010601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:12.028748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec027f67-7df1-4cf0-9dcd-912689f55171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.029987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027f67-7df1-4cf0-9dcd-912689f55171 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.030267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027f67-7df1-4cf0-9dcd-912689f55171 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.030539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec027f67-7df1-4cf0-9dcd-912689f55171 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.031329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec027f67-7df1-4cf0-9dcd-912689f55171 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:12.031632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec027f67-7df1-4cf0-9dcd-912689f55171 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.033078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec027f67-7df1-4cf0-9dcd-912689f55171 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.045784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 284/581] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:12.047054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80181d9-b08e-45aa-9529-ea45d240b4f4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.047348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80181d9-b08e-45aa-9529-ea45d240b4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.047628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80181d9-b08e-45aa-9529-ea45d240b4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.065792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c80181d9-b08e-45aa-9529-ea45d240b4f4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:12.067243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c80181d9-b08e-45aa-9529-ea45d240b4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:12.069727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22662-02b5-4b79-bfff-8237a468678a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.099983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:12.107390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.108228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.108518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.108800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.116614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.118071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:12.133907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:12.134922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 298/582] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:12.135877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.143721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 285/583] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:12.145210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80181d9-b08e-45aa-9529-ea45d240b4f4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.245795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e52d25-7c3b-4d33-b09b-27143d81add3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.264695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80181d9-b08e-45aa-9529-ea45d240b4f4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.274105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:12.288560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.289293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.289575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.289849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.290696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:12.291004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.292470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.303032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560dedd-8169-4b5c-ba85-7f6968bf0076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.303983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560dedd-8169-4b5c-ba85-7f6968bf0076 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.304350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560dedd-8169-4b5c-ba85-7f6968bf0076 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.304683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560dedd-8169-4b5c-ba85-7f6968bf0076 None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/00b59b80b61a4dec8f4df2bc8a45d340/roles/abfe24af6ff444fcbd747639e12c2a73` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.314275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 299/584] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:12.314275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.322075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560dedd-8169-4b5c-ba85-7f6968bf0076 None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=00b59b80b61a4dec8f4df2bc8a45d340, role_id=abfe24af6ff444fcbd747639e12c2a73)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.323640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560dedd-8169-4b5c-ba85-7f6968bf0076 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.336975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 286/585] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:12 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/00b59b80b61a4dec8f4df2bc8a45d340/roles/abfe24af6ff444fcbd747639e12c2a73 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:12.337903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560dedd-8169-4b5c-ba85-7f6968bf0076 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.398203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:12.476688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44900a-2636-4212-b6b3-187c5d9613e0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.478928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560dedd-8169-4b5c-ba85-7f6968bf0076 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.527013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.528090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.528604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.529138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.530231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:12.530609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.532161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.536850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786df4fe-da54-4fdb-a5eb-702638e236c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.537737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786df4fe-da54-4fdb-a5eb-702638e236c6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.538096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786df4fe-da54-4fdb-a5eb-702638e236c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.538374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786df4fe-da54-4fdb-a5eb-702638e236c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.549766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786df4fe-da54-4fdb-a5eb-702638e236c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:12.554307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 300/586] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:12.555252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-786df4fe-da54-4fdb-a5eb-702638e236c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:12.557795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:12.558724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:12.559568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 287/587] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:12.567956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786df4fe-da54-4fdb-a5eb-702638e236c6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.591123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:12.673849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de5159-336c-43bc-8397-4ba2ce97cdde None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.681495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786df4fe-da54-4fdb-a5eb-702638e236c6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.684053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:12.714314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.715482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.715970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.716588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.719939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.720846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.721197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.721539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.728679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.730371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.733540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.735121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:12.753659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:12.755488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:12.756459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:12.756459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:12.756459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:12.756459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:12.756459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 288/588] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:12.757233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:12.758688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:12.760048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:12.760048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:12.760048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:12.760048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:12.760324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.766582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 301/589] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:12.768166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.838211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:12.881392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cbb00-4f3c-4a16-b766-aaf1a706e30e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.883259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0301d0-73c1-41b1-a758-92b35f0f32f3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:12.918776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.919450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.920375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.920786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.921547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:12.921860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.922686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:12.923239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.924016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:12.924508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:12.924983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:12.925987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:12.926724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:12.929554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:12.937344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 289/590] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:12.938957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.943667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 302/591] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:12.944828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:12.965194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:13.056282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141799e-3855-4840-af77-3b74d922ff78 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.056909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49b786-d75e-4729-9be9-647589517d92 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.088799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:13.095046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.095243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.095721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.096007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.096335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.096661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.097072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:13.097254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.097358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.097747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.098745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.110614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.116649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.116785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 290/592] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:13.116785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:13.139918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:13.141116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:13.142201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:13.142201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:13.142201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:13.142201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:13.144179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 303/593] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:13.145132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.221457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:13.242093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f3bd3d-7dee-4a99-b2cc-2f8e6f69f842 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.256813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf750943-e4de-4cc1-b9cd-a49829b12692 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.280553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.281492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.281974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.282347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.290228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.291845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.294139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.295227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.295651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.296090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.303004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.304649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:13.307372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:13.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:13.309517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:13.309517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:13.309517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:13.309517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:13.309517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:13.309517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:13.309517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:13.309517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:13.315806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 291/594] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:13.317072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:13.323026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:13.324054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:13.325129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:13.325129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:13.325129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:13.325129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:13.325129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:13.325129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:13.325129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:13.325129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:13.332333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 304/595] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:13.333535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.379808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:13.436439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe105-192b-4407-a662-18d3bbe9debb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.442603 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054142e-8ae7-46dd-9e19-d7ae354f88dc None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.474214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:13.476363 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.477118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.477734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.478173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.479838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:13.480181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.482130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.482404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.483291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.483867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.484378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.485415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:13.485922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.487617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.504145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 292/597] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:13.504145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.504420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 305/597] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:13.507887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.630662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc893d-12ca-4981-a6e9-747f48014700 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.645196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:13.656289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e2937-b290-4b8c-82d7-ef5cdd4bc5e3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.668959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.669678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.669934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.670209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.671000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:13.671305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.672772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.690230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 293/598] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:13.690230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.700638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.702623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.703052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.703459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.711515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.713191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:13.727563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:13.728578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:04:13.729512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:13.732129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 306/599] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:13.733090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.784510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:13.807169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0066b-db1c-422b-87cc-6e52c1bbf5db None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.835870 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a830a-4581-433e-9059-98cc65c52366 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:13.846382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68485d-acff-4d16-89b9-8f9fb4fa0c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.847274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68485d-acff-4d16-89b9-8f9fb4fa0c79 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.847573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68485d-acff-4d16-89b9-8f9fb4fa0c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.847823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68485d-acff-4d16-89b9-8f9fb4fa0c79 None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/c46f7ca6d48c4124a9af1dc3a74c37a5/roles/abfe24af6ff444fcbd747639e12c2a73` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.862893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68485d-acff-4d16-89b9-8f9fb4fa0c79 None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=c46f7ca6d48c4124a9af1dc3a74c37a5, role_id=abfe24af6ff444fcbd747639e12c2a73)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.864356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68485d-acff-4d16-89b9-8f9fb4fa0c79 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.872431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc5add-696d-47db-9089-c821323e8bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:13.874409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc5add-696d-47db-9089-c821323e8bc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.874869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc5add-696d-47db-9089-c821323e8bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.875471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc5add-696d-47db-9089-c821323e8bc7 None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/4c97bd14230147a5bd004c71f5387098/roles/abfe24af6ff444fcbd747639e12c2a73` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.884212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 294/600] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:13 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/c46f7ca6d48c4124a9af1dc3a74c37a5/roles/abfe24af6ff444fcbd747639e12c2a73 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:13.884212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68485d-acff-4d16-89b9-8f9fb4fa0c79 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:13.906874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:13.911727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc5add-696d-47db-9089-c821323e8bc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=4c97bd14230147a5bd004c71f5387098, role_id=abfe24af6ff444fcbd747639e12c2a73)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:13.915797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc5add-696d-47db-9089-c821323e8bc7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:13.940847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 307/601] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:13 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/4c97bd14230147a5bd004c71f5387098/roles/abfe24af6ff444fcbd747639e12c2a73 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:13.942847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577ce1-da7b-494a-accd-c75b95114ae8 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.943176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577ce1-da7b-494a-accd-c75b95114ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.943479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577ce1-da7b-494a-accd-c75b95114ae8 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.946146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 308/602] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:13.952375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f4b5-fbec-4ddb-9ff5-341c3272b5ae None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:13.953134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f4b5-fbec-4ddb-9ff5-341c3272b5ae None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:13.953543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513f4b5-fbec-4ddb-9ff5-341c3272b5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:13.979182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f513f4b5-fbec-4ddb-9ff5-341c3272b5ae None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:13.981602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f513f4b5-fbec-4ddb-9ff5-341c3272b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:14.018992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68485d-acff-4d16-89b9-8f9fb4fa0c79 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:14.065395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 309/603] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:14.070390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:14.071089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.071372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.071714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.072667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:14.073030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:14.074631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:14.090534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513f4b5-fbec-4ddb-9ff5-341c3272b5ae None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.098391 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 295/604] 10.222.0.17 () {56 vars in 1139 bytes} [Thu Jul 14 11:04:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:14.103939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.125072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:14.198114 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:14.208233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513f4b5-fbec-4ddb-9ff5-341c3272b5ae None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:14.222431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53b62a-af64-47aa-91e5-c6129fb0cf12 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:14.245396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fdfb0-e808-4dbb-b6ea-909deeb1bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:14.246574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fdfb0-e808-4dbb-b6ea-909deeb1bc81 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.247056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fdfb0-e808-4dbb-b6ea-909deeb1bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.247530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fdfb0-e808-4dbb-b6ea-909deeb1bc81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.259637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fdfb0-e808-4dbb-b6ea-909deeb1bc81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:14.260254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:14.261065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.261347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.261622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-e51fdfb0-e808-4dbb-b6ea-909deeb1bc81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:14.269382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:14.270416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:14.271259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:14.273486 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:14.274226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 310/605] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:14.279640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:14.280808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fdfb0-e808-4dbb-b6ea-909deeb1bc81 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:14.294643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:14.295623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:14.296553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:14.296553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:14.296553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:14.296553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:14.299902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 296/606] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:14.301766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.392752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fdfb0-e808-4dbb-b6ea-909deeb1bc81 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:14.400434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:14.429979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:14.430896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.431280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.431653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.432549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:14.432954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:14.434442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:14.441044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e05df6-e40a-4860-a7d0-ce76380567bb None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:14.448535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 311/607] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:14.449826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.502687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:14.511997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:14.523197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.523197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.523197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.524047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:14.524047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:14.525483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:14.556305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 297/608] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:14.562321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.636045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe18f-2f33-4bcf-b182-d4a2bcf2bc9a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:14.680855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c79d0-f983-4c83-827e-11a1b8e3c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:14.682713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c79d0-f983-4c83-827e-11a1b8e3c45b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.683218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c79d0-f983-4c83-827e-11a1b8e3c45b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.683708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c79d0-f983-4c83-827e-11a1b8e3c45b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.699465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c79d0-f983-4c83-827e-11a1b8e3c45b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:14.701920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c79d0-f983-4c83-827e-11a1b8e3c45b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:14.702935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03dd2e7-8668-43c6-ac1e-1e70b89f54f5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-8d1c79d0-f983-4c83-827e-11a1b8e3c45b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:14.725072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:14.726139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:14.727073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:14.727073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:14.727073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:14.727073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:14.734763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 312/609] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:14.734763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f1b4e-eb26-4aea-b18f-188a7dd24732 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.734763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f1b4e-eb26-4aea-b18f-188a7dd24732 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.734763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f1b4e-eb26-4aea-b18f-188a7dd24732 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.735885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 313/610] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:14.736490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f1b4e-eb26-4aea-b18f-188a7dd24732 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.740425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:14.749236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33967ee-13b0-4073-a3db-3100d08204be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:14.750330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33967ee-13b0-4073-a3db-3100d08204be None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.750826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33967ee-13b0-4073-a3db-3100d08204be None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.751300 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33967ee-13b0-4073-a3db-3100d08204be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.758469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33967ee-13b0-4073-a3db-3100d08204be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:14.760150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33967ee-13b0-4073-a3db-3100d08204be None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f33967ee-13b0-4073-a3db-3100d08204be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:14.774790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:14.775739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:14.776997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:14.776997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:14.776997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:14.776997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:14.776997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:14.776997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:14.776997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:14.776997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:14.778983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 298/611] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:14.780590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b778-7a2f-4a94-ac77-5420c60428e5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.781265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b778-7a2f-4a94-ac77-5420c60428e5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.781738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0b778-7a2f-4a94-ac77-5420c60428e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.808189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b0a0b778-7a2f-4a94-ac77-5420c60428e5 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:14.810762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b0a0b778-7a2f-4a94-ac77-5420c60428e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:14.851802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f1b4e-eb26-4aea-b18f-188a7dd24732 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:14.872406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:14.889929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:14.890526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:14.890817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:14.891096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:14.891832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:14.892223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:14.893777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:14.899617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 299/612] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:14.901364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0b778-7a2f-4a94-ac77-5420c60428e5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.910696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 314/613] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:14.912995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:14.989050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:15.028608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0b778-7a2f-4a94-ac77-5420c60428e5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.030361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec4d57-2592-4948-8e78-cafa3f49c5b2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.067736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.068598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.068874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.069149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.073849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.074779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.075263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.075762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.077008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:15.077128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:15.077611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:15.078612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:15.079488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:15.093651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 300/614] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:15.094727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:15.102944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:15.103923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:15.105206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:15.108594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 315/615] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:15.109506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.153171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:15.223594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1a5e-5180-453c-a3c4-ae7b02a2cb08 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.224362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b4a25-a9cf-4555-a84c-672caeb25d25 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.250996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:15.261986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4035aba-5d23-4858-8b69-8d51ec7ea5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.263028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035aba-5d23-4858-8b69-8d51ec7ea5fd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.263495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035aba-5d23-4858-8b69-8d51ec7ea5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.263933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4035aba-5d23-4858-8b69-8d51ec7ea5fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.264500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b600a8f-eb9a-4105-900b-dc770d2a0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.265506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b600a8f-eb9a-4105-900b-dc770d2a0b29 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.265891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b600a8f-eb9a-4105-900b-dc770d2a0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.266269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b600a8f-eb9a-4105-900b-dc770d2a0b29 None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/a367d904a4a44e91862da4aea28a123b/roles/abfe24af6ff444fcbd747639e12c2a73` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.276519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4035aba-5d23-4858-8b69-8d51ec7ea5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:15.285100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b600a8f-eb9a-4105-900b-dc770d2a0b29 None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=a367d904a4a44e91862da4aea28a123b, role_id=abfe24af6ff444fcbd747639e12c2a73)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d4035aba-5d23-4858-8b69-8d51ec7ea5fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:15.285882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:15.286952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:15.287788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:15.288491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b600a8f-eb9a-4105-900b-dc770d2a0b29 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:15.290717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 301/616] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:15.291847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4035aba-5d23-4858-8b69-8d51ec7ea5fd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.304908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 316/617] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:15 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/a367d904a4a44e91862da4aea28a123b/roles/abfe24af6ff444fcbd747639e12c2a73 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:15.305915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b600a8f-eb9a-4105-900b-dc770d2a0b29 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.410923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4035aba-5d23-4858-8b69-8d51ec7ea5fd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.413164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:15.430341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b600a8f-eb9a-4105-900b-dc770d2a0b29 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.452234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.453215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.453692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.454153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.455324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:15.455812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:15.457567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:15.470404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.471151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.471442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.471724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.472617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:15.472929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:15.474378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:15.480093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 302/618] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Jul 14 11:04:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:15.487486 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.492759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 317/619] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:15.494525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.588527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:15.639237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b4785-b498-429e-aaa0-3e25e3cfefe6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.643188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b4cee-983c-4e76-b01d-086fd4d351bf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.676976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.677975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.678329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.678672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.681334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.682305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.682742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.683125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.690236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:15.691952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:15.697368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:15.698927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:15.712484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:15.713993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:15.715143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:15.715143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:15.715143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:15.715143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:15.715143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 303/620] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:15.720922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:15.721588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:15.722762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:15.723672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:15.723672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:15.723672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:15.723672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:15.723672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 318/621] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:15.736818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.756333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:15.859724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f3dd4-812e-4076-9755-b90bf871ac1f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:15.896093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:15.897081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:15.897372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:15.897654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:15.898381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:15.898692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:15.900174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:15.913490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 304/622] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:15.920144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:15.988504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:16.011136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a50120-f46e-40c8-8731-16323f0c4aa7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:16.072395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:16.086185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:16.086862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.087148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.087419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.088164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:16.088471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:16.089850 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:16.116890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 319/623] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:16.121099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772b31-84ad-40b3-90f8-3b0fe5a5d769 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:16.127976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:16.194098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:16.195189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.195628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.195902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.209509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:16.210983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:16.236669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:16.237650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:16.238558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:16.238558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:16.238558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:16.238558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:16.238558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:16.238558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:16.238558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:16.238558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:16.245729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 305/624] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:16.251127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:16.278601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6834bec-f10f-4eb0-a362-32e47c5ab10a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:16.320309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34d36a-ffb3-42a4-b9a7-e262b5f8040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:16.321140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34d36a-ffb3-42a4-b9a7-e262b5f8040d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.321423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34d36a-ffb3-42a4-b9a7-e262b5f8040d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.321697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34d36a-ffb3-42a4-b9a7-e262b5f8040d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.329951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34d36a-ffb3-42a4-b9a7-e262b5f8040d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:16.331403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34d36a-ffb3-42a4-b9a7-e262b5f8040d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-df34d36a-ffb3-42a4-b9a7-e262b5f8040d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:16.347052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:16.348067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:16.349064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 320/625] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:04:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:16.350135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2fd61-63c9-4934-88bb-827b6fc8f74f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.350135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2fd61-63c9-4934-88bb-827b6fc8f74f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.350378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2fd61-63c9-4934-88bb-827b6fc8f74f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.356266 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 321/626] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:16.357573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2fd61-63c9-4934-88bb-827b6fc8f74f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:16.368853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:16.396479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de6a92-ab35-451e-b6a3-162d92b73da0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:16.435989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:16.442783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c75dbb-3d0b-465f-a7cb-fd73af2541da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:16.443979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c75dbb-3d0b-465f-a7cb-fd73af2541da None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.444471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c75dbb-3d0b-465f-a7cb-fd73af2541da None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.445197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c75dbb-3d0b-465f-a7cb-fd73af2541da None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.446440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c75dbb-3d0b-465f-a7cb-fd73af2541da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:16.446909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c75dbb-3d0b-465f-a7cb-fd73af2541da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:16.449093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c75dbb-3d0b-465f-a7cb-fd73af2541da None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:16.463423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 306/627] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:16.466151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9cbe4-d889-4b4a-afcf-982bb58a721c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.467206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9cbe4-d889-4b4a-afcf-982bb58a721c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.467708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9cbe4-d889-4b4a-afcf-982bb58a721c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.469903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2fd61-63c9-4934-88bb-827b6fc8f74f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:16.486982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e7a9cbe4-d889-4b4a-afcf-982bb58a721c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:16.488213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e7a9cbe4-d889-4b4a-afcf-982bb58a721c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:16.505290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d7d9c-7890-49ee-ba64-cb8d055de160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:16.506231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7d9c-7890-49ee-ba64-cb8d055de160 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.506699 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7d9c-7890-49ee-ba64-cb8d055de160 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.507174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d7d9c-7890-49ee-ba64-cb8d055de160 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.508237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7d9c-7890-49ee-ba64-cb8d055de160 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:16.508635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7d9c-7890-49ee-ba64-cb8d055de160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:16.510071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d7d9c-7890-49ee-ba64-cb8d055de160 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:16.538729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 322/628] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:04:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:16.538729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68217591-bd07-4dd6-a585-f7a13331a8bb None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.538729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68217591-bd07-4dd6-a585-f7a13331a8bb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.538729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68217591-bd07-4dd6-a585-f7a13331a8bb None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.538729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 323/629] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:16.538729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68217591-bd07-4dd6-a585-f7a13331a8bb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:16.564311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 307/630] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:16.565008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9cbe4-d889-4b4a-afcf-982bb58a721c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:16.614997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:16.657596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68217591-bd07-4dd6-a585-f7a13331a8bb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:16.674389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9cbe4-d889-4b4a-afcf-982bb58a721c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:16.692371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbec891-621a-4925-b378-11f37ad29cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:16.693271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbec891-621a-4925-b378-11f37ad29cfd None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.693555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbec891-621a-4925-b378-11f37ad29cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.694056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbec891-621a-4925-b378-11f37ad29cfd None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/23cd2e48acd9491cb513274c8ce3641f/roles/abfe24af6ff444fcbd747639e12c2a73` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.700426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:16.710599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbec891-621a-4925-b378-11f37ad29cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=23cd2e48acd9491cb513274c8ce3641f, role_id=abfe24af6ff444fcbd747639e12c2a73)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:16.712258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbec891-621a-4925-b378-11f37ad29cfd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:16.714782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b934a73-3a25-4b74-84f5-21ddbbefc2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:16.715443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b934a73-3a25-4b74-84f5-21ddbbefc2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.715728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b934a73-3a25-4b74-84f5-21ddbbefc2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.716003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b934a73-3a25-4b74-84f5-21ddbbefc2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.736139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 324/631] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:16 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/23cd2e48acd9491cb513274c8ce3641f/roles/abfe24af6ff444fcbd747639e12c2a73 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:16.736139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7988bf-3a95-48b9-a062-5daa9c37a75a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:16.736139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7988bf-3a95-48b9-a062-5daa9c37a75a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:16.736139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7988bf-3a95-48b9-a062-5daa9c37a75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:16.755283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-df7988bf-3a95-48b9-a062-5daa9c37a75a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:16.756595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-df7988bf-3a95-48b9-a062-5daa9c37a75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:16.808782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b934a73-3a25-4b74-84f5-21ddbbefc2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:16.811028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b934a73-3a25-4b74-84f5-21ddbbefc2d8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:16.847847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 325/632] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:16.848865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7988bf-3a95-48b9-a062-5daa9c37a75a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:16.905299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:16.953637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 308/633] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:16.954804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b934a73-3a25-4b74-84f5-21ddbbefc2d8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:16.971376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7988bf-3a95-48b9-a062-5daa9c37a75a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:16.985736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:17.017200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec82cb-b292-4db8-8633-0435f3b9f65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.018546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec82cb-b292-4db8-8633-0435f3b9f65a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.018931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec82cb-b292-4db8-8633-0435f3b9f65a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.019313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec82cb-b292-4db8-8633-0435f3b9f65a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.033591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec82cb-b292-4db8-8633-0435f3b9f65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-10ec82cb-b292-4db8-8633-0435f3b9f65a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:17.043803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:17.045483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:17.046332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:17.051892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 326/634] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:17.052862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec82cb-b292-4db8-8633-0435f3b9f65a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.090041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b934a73-3a25-4b74-84f5-21ddbbefc2d8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.130355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf56d59-4da0-4c57-b3f8-39ee8cd8f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.131237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf56d59-4da0-4c57-b3f8-39ee8cd8f650 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.131524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf56d59-4da0-4c57-b3f8-39ee8cd8f650 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.131796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf56d59-4da0-4c57-b3f8-39ee8cd8f650 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.143538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf56d59-4da0-4c57-b3f8-39ee8cd8f650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fcf56d59-4da0-4c57-b3f8-39ee8cd8f650 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:17.152121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:17.153055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:17.153960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 309/635] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:17.154674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf56d59-4da0-4c57-b3f8-39ee8cd8f650 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.163414 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec82cb-b292-4db8-8633-0435f3b9f65a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.171884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:17.202663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.203632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.204068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.204424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.215913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.217631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:17.237481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:17.238639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:17.239740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:17.239740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:17.239740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:17.239740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:17.242134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 327/636] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:17.242134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.263005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:17.287179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf56d59-4da0-4c57-b3f8-39ee8cd8f650 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.327064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.327762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.328047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.328371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.329144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:17.329448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.331365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.343263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 310/637] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:17.349459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.359876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78fe4f-0506-40a4-9a2e-a48e524de39d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.402303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.403330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.404392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.404901 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.405933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:17.406438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.408176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.417558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 328/638] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:17.418810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.448507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:17.473915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5857a-d1eb-407f-bc7d-175d63ab8d6d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.509849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.510518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.510847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.511126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.511904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:17.512283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.515910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.524554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c7a7-621e-4139-a727-63731afe276f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.531369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 311/639] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:17.532332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.539704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:17.571423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.572818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.573358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.573817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.588238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.590994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:17.615203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:17.616182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:17.617085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:17.617085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:17.617085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:17.617085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:17.619750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 329/640] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:17.620740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.651847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb55b-d950-4bcd-8c21-e48f6426f12d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.689874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.690838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.691222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.691849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.702794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.704413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.716764 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:17.723038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:17.724568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:17.725691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:17.725691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:17.725691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:17.725691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:17.727272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 312/641] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:17.728292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.757062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e57103-937f-443d-aed4-1f9a683c2826 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.786450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:17.794975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.795774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.796051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.796364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.803166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.804659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:17.819996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:17.821113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:17.822114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 330/642] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:17.822600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.837318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515bb55-3286-4e82-878c-0afb0a711d15 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.874128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b0165-e347-44c7-95c2-8dae78393c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.874790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0165-e347-44c7-95c2-8dae78393c48 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.875070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0165-e347-44c7-95c2-8dae78393c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.875344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0165-e347-44c7-95c2-8dae78393c48 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.876061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b0165-e347-44c7-95c2-8dae78393c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:17.876385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b0165-e347-44c7-95c2-8dae78393c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.877746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b0165-e347-44c7-95c2-8dae78393c48 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.889302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 313/643] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:17.890558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a103-bec9-469a-ad12-6e734d6dcba3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.890844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a103-bec9-469a-ad12-6e734d6dcba3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.891115 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9a103-bec9-469a-ad12-6e734d6dcba3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.896466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 314/644] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:17.896466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9a103-bec9-469a-ad12-6e734d6dcba3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:17.934762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861c45a-ae41-467a-9d3a-058a192a89c0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:17.967251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:17.973010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:17.973802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:17.974083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:17.974358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:17.975142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:17.975393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:17.976936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:17.993542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 331/645] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:17.993542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.016927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9a103-bec9-469a-ad12-6e734d6dcba3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.034074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:18.053762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cdb20-ab05-46d0-8871-6bb46f9c852a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.054567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cdb20-ab05-46d0-8871-6bb46f9c852a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.054913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cdb20-ab05-46d0-8871-6bb46f9c852a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.055190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cdb20-ab05-46d0-8871-6bb46f9c852a None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.055973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cdb20-ab05-46d0-8871-6bb46f9c852a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:18.056310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cdb20-ab05-46d0-8871-6bb46f9c852a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:18.057739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cdb20-ab05-46d0-8871-6bb46f9c852a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:18.070701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 315/646] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:18.071929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29789a83-dee0-445b-9979-e90a4f260d91 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.072238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29789a83-dee0-445b-9979-e90a4f260d91 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.072513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29789a83-dee0-445b-9979-e90a4f260d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.088468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-29789a83-dee0-445b-9979-e90a4f260d91 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:18.089627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-29789a83-dee0-445b-9979-e90a4f260d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:18.110053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60ed1d-52f8-4ed5-854a-cec27406d056 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.146773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.147567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.147848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.148136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.156200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:18.157634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:18.158277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 316/647] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:18.159192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29789a83-dee0-445b-9979-e90a4f260d91 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:18.184010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:18.185063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:04:18.186023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:18.188502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 332/648] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:18.189675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.250671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:18.266596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29789a83-dee0-445b-9979-e90a4f260d91 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.274787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:18.302408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80423de4-4a42-40ce-a211-1568671eaf1b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.306598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.307557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.308007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.308443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.317277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:18.319131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:18.334534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:18.335672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 11:04:18.336814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:18.337469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.337469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.337469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.337469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.337772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=00b59b80b61a4dec8f4df2bc8a45d340) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:18.337772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:18.338447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:18.339739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 317/649] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:18.340860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.351509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 333/650] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/role_assignments?user.id=00b59b80b61a4dec8f4df2bc8a45d340&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:18.352618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.476976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaf4e9-f9fe-41c6-bbba-addc9e17499e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.500230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:18.501586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f39f2-9071-4b47-bb21-a5d3a85b3a70 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.534985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.535990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.536524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.537020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.538077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:18.538565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:18.540606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:18.554559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e7f70-89e2-44ac-bfe9-0e003eeb573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.555623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e7f70-89e2-44ac-bfe9-0e003eeb573f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.555900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e7f70-89e2-44ac-bfe9-0e003eeb573f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.556202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e7f70-89e2-44ac-bfe9-0e003eeb573f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.565265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 334/651] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:18.566669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.572796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e7f70-89e2-44ac-bfe9-0e003eeb573f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-be8e7f70-89e2-44ac-bfe9-0e003eeb573f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:18.581268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:18.582219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:18.583081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:18.585168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 318/652] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:18.585168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e7f70-89e2-44ac-bfe9-0e003eeb573f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.620388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:18.691207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d52ad-a870-491e-9884-8a0569e94ccf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.724997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e7f70-89e2-44ac-bfe9-0e003eeb573f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.737609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.739084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.739756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.740386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.741732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:18.742720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:18.744943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:18.767609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5035d-9a84-4a5b-bbde-52d1ab6a5b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.768224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5035d-9a84-4a5b-bbde-52d1ab6a5b36 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.768513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5035d-9a84-4a5b-bbde-52d1ab6a5b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.768790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5035d-9a84-4a5b-bbde-52d1ab6a5b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.769814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 335/653] 10.222.0.17 () {56 vars in 1137 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:18.771222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.810999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:18.850267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5035d-9a84-4a5b-bbde-52d1ab6a5b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:18.853538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5035d-9a84-4a5b-bbde-52d1ab6a5b36 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:18.885981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:18.891352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05285ddb-c8f1-465a-b5bc-1aedc560af67 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:18.928239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:18.928919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:18.929208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:18.929487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:18.930528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:18.930528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:18.931919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:18.940981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 336/654] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:18.942106 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:18.969194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 319/655] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:18.970387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5035d-9a84-4a5b-bbde-52d1ab6a5b36 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.039235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:19.046682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a57aa-cc87-47b5-96b6-e089f439c27e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.077280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5035d-9a84-4a5b-bbde-52d1ab6a5b36 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.079553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdac762-21df-4092-bfdf-3632cd1c64fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.080247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac762-21df-4092-bfdf-3632cd1c64fd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.080538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac762-21df-4092-bfdf-3632cd1c64fd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.080819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdac762-21df-4092-bfdf-3632cd1c64fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.107805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:19.117989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f2fe6-795d-4064-9c40-2e12ebcd9c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.118791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2fe6-795d-4064-9c40-2e12ebcd9c36 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.119073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2fe6-795d-4064-9c40-2e12ebcd9c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.119345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2fe6-795d-4064-9c40-2e12ebcd9c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.130290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f2fe6-795d-4064-9c40-2e12ebcd9c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.131867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f2fe6-795d-4064-9c40-2e12ebcd9c36 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.150467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdac762-21df-4092-bfdf-3632cd1c64fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d26f2fe6-795d-4064-9c40-2e12ebcd9c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:19.151308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:19.152235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:19.153154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:19.153154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:19.153154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:19.153154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:19.153375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdac762-21df-4092-bfdf-3632cd1c64fd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.153453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 320/656] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:19.154679 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918abcba-1240-4cb0-9c6d-4d3507b5c3c1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.154954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918abcba-1240-4cb0-9c6d-4d3507b5c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.155230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918abcba-1240-4cb0-9c6d-4d3507b5c3c1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.160228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 321/657] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:19.160228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918abcba-1240-4cb0-9c6d-4d3507b5c3c1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.255608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:19.265370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 337/658] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:19.266439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdac762-21df-4092-bfdf-3632cd1c64fd None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.272781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918abcba-1240-4cb0-9c6d-4d3507b5c3c1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.308054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af06383-0bff-463f-b81b-619b41c7994a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.308796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af06383-0bff-463f-b81b-619b41c7994a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.309078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af06383-0bff-463f-b81b-619b41c7994a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.309471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af06383-0bff-463f-b81b-619b41c7994a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.319854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af06383-0bff-463f-b81b-619b41c7994a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.321349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af06383-0bff-463f-b81b-619b41c7994a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3af06383-0bff-463f-b81b-619b41c7994a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:19.339184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:19.340144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:19.341067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:19.341067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:19.341067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:19.341067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:19.341067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 322/659] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:19.342385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ac2a-e5e8-4ad3-a43a-c421b150e8a4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.342385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ac2a-e5e8-4ad3-a43a-c421b150e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.342663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ac2a-e5e8-4ad3-a43a-c421b150e8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.358453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7d65ac2a-e5e8-4ad3-a43a-c421b150e8a4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:19.359666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7d65ac2a-e5e8-4ad3-a43a-c421b150e8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:19.374525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdac762-21df-4092-bfdf-3632cd1c64fd None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.383193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:19.411521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.412237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.412542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.412821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.413522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:19.413826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.415194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.431333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 338/660] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:19.431516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 323/661] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:19.431599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.431677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ac2a-e5e8-4ad3-a43a-c421b150e8a4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.495945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:19.548250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ac2a-e5e8-4ad3-a43a-c421b150e8a4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.548622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d960-9b6d-42e8-b71b-fc0ca2b1e524 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.587583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.588406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.588689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.588964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.591208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.591957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.592285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.592557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.593282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:19.593582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.594949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.599791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.601282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.611564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 324/662] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:19.611564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:19.625008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:19.626174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:19.627085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:19.627085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:19.627085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:19.627085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:19.627085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 339/663] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:19.627085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.642385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:19.731063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60c375-643e-4c28-af40-27b56dadeee9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.733678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd62627-1aa4-48be-92a0-8e56316744f3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.741785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:19.770552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.771044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36267b-194d-49a8-b142-788cb9ddebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.771840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36267b-194d-49a8-b142-788cb9ddebff None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.772138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36267b-194d-49a8-b142-788cb9ddebff None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.772420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36267b-194d-49a8-b142-788cb9ddebff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.772927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.773410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.773876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.781890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.782734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36267b-194d-49a8-b142-788cb9ddebff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:19.783823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-bb36267b-194d-49a8-b142-788cb9ddebff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:19.790440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:19.791521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 340/664] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:19.797239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36267b-194d-49a8-b142-788cb9ddebff None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:19.800966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:19.801887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 11:04:19.802853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:19.804247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 325/665] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:19.805037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.893161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:19.905319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36267b-194d-49a8-b142-788cb9ddebff None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.914799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d0910-8785-4d67-bf5d-c4dcadaa5c1c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:19.945187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.945984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.946262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.946534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.953286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.954754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.955380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:19.956046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:19.956387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:19.956625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:19.957350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:19.957656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:19.959177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:19.969101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:19.970034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:19.970947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 341/666] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:19.971465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:19.983177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 326/667] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:19.983177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.002359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.079409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992eda-8f1b-44c4-b081-2b5aa1f27990 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.093859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b335c93-2dfa-4132-8260-f56c29c6b994 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.114212 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.115095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.115212 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.115417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.116205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:20.116513 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.117888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.126471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 342/668] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:20.127269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.135337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.136315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.136800 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.137261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.138379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:20.138883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.140794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.150288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.161531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 327/669] 10.222.0.17 () {56 vars in 1139 bytes} [Thu Jul 14 11:04:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:20.162427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.228260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.243292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5b91-5944-440f-8b37-1a69e40362eb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.270087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9758c7-1768-4b88-a6ac-27339e515f80 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.280575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.281003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.281282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.281554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.282336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:20.282641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.284066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.297641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 343/670] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:20.298967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.307400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.308226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.308520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.308771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.316041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.317775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:20.331767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:20.332963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:20.333868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 328/671] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:20.334371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.402674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.422896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f16707-5c8c-42fa-b1da-2334a26a65f1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.449321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498532f-e456-438d-acab-b257bdf09768 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.458981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.459782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.460097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.460472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.472142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.473591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.482820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.491135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c858-0c93-44a3-9e66-acd324db9a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.491792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c858-0c93-44a3-9e66-acd324db9a11 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.492070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c858-0c93-44a3-9e66-acd324db9a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.492371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2c858-0c93-44a3-9e66-acd324db9a11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:20.494094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:20.495132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:20.496021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:20.496021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:20.496021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:20.496021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:20.498261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 344/672] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:20.498946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.574212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2c858-0c93-44a3-9e66-acd324db9a11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.575698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2c858-0c93-44a3-9e66-acd324db9a11 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.607572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa91cab-f16a-4295-a132-fe65960e4ff8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.631621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.640970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.641623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.641907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.642180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.643004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=c46f7ca6d48c4124a9af1dc3a74c37a5) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:20.643307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.644770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.650848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 345/673] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/role_assignments?user.id=c46f7ca6d48c4124a9af1dc3a74c37a5&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:20.651413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.694462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 329/674] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:20.695758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c858-0c93-44a3-9e66-acd324db9a11 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.724380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.766498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66059730-a191-4ab1-a71d-4b261fd5f705 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.803551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de41a0-d202-4dc8-8eb9-1a01bcba2eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.804527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de41a0-d202-4dc8-8eb9-1a01bcba2eab None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.804527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de41a0-d202-4dc8-8eb9-1a01bcba2eab None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.804805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de41a0-d202-4dc8-8eb9-1a01bcba2eab None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.805599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de41a0-d202-4dc8-8eb9-1a01bcba2eab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:20.805911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de41a0-d202-4dc8-8eb9-1a01bcba2eab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.807340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de41a0-d202-4dc8-8eb9-1a01bcba2eab None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.811057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2c858-0c93-44a3-9e66-acd324db9a11 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.820258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 346/675] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:20.821719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308edbbd-cdc7-4747-9eb5-4da669bfa26f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.822290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308edbbd-cdc7-4747-9eb5-4da669bfa26f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.822290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308edbbd-cdc7-4747-9eb5-4da669bfa26f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.828187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 347/676] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:20.828187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308edbbd-cdc7-4747-9eb5-4da669bfa26f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.855079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.855757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.856040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.856352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.857123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:20.857432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:20.859067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:20.871218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 330/677] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:20.872155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:20.894129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.948809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308edbbd-cdc7-4747-9eb5-4da669bfa26f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:20.975956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:20.992209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b17ef-fb35-477b-824c-d8df53495bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:20.993300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b17ef-fb35-477b-824c-d8df53495bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:20.993747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b17ef-fb35-477b-824c-d8df53495bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:20.994188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b17ef-fb35-477b-824c-d8df53495bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:20.994574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789885e-5088-4232-8d2a-42398e0a67c0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.006416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b17ef-fb35-477b-824c-d8df53495bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.008262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b17ef-fb35-477b-824c-d8df53495bd4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:21.037934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.038613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.038900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-9e8b17ef-fb35-477b-824c-d8df53495bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:21.039118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:21.040143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:21.041705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:21.041705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:21.041705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:21.041705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:21.043216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.043216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=4c97bd14230147a5bd004c71f5387098) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:21.043216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.043216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:21.044942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 348/678] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:21.046391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0b021-368d-43c2-b43c-7a0c72a2dd1e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.046680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0b021-368d-43c2-b43c-7a0c72a2dd1e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.046977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0b021-368d-43c2-b43c-7a0c72a2dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.053770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 331/679] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:20 2022] GET /identity/v3/role_assignments?user.id=4c97bd14230147a5bd004c71f5387098&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:21.054820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:21.072217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8fa0b021-368d-43c2-b43c-7a0c72a2dd1e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:21.073652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8fa0b021-368d-43c2-b43c-7a0c72a2dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:21.177327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 349/680] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:21.177327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0b021-368d-43c2-b43c-7a0c72a2dd1e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:21.214393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:21.247174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d5d1f-1ecf-4567-be52-687493c27838 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.296937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.298042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.298324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.298602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.315104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.316875 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:21.333784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:21.334844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:21.335807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 332/681] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:21.336467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:21.382299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0b021-368d-43c2-b43c-7a0c72a2dd1e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.397200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:21.438923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.440082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.440775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.441046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.442609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:21.442926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.448279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:21.461596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 350/682] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:21.461596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:21.493664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839e967-6856-4815-b7aa-3658db601d26 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.531792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba28f8-e6ad-4fd5-91e3-045530e866b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.532876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba28f8-e6ad-4fd5-91e3-045530e866b3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.533308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba28f8-e6ad-4fd5-91e3-045530e866b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.533730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba28f8-e6ad-4fd5-91e3-045530e866b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.547052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba28f8-e6ad-4fd5-91e3-045530e866b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a1ba28f8-e6ad-4fd5-91e3-045530e866b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:21.555234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:21.556514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:21.557443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:21.559939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 333/683] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:21.561682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba28f8-e6ad-4fd5-91e3-045530e866b3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:21.565507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:21.571243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9d27-7c1f-455c-962c-615efe2e279a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.608384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.609478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.609478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.609653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.610462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:21.610773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.612393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:21.636689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 351/684] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:21.637551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:21.664573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:21.677109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba28f8-e6ad-4fd5-91e3-045530e866b3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.715546 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.716862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.717373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.717872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.725733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.727519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:21.743906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:21.744902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:21.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:21.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:21.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:21.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:21.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:21.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:21.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:21.745821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:21.753376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 334/685] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:21.754636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:21.762316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cdda6-a9a6-4080-9caa-22d5957d1806 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.799955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.800685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.800973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.801257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.802088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:21.802326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.803787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:21.813262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 352/686] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:21.814202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:21.826700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:21.870849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08717-6f0f-4609-8dbe-e70d7ae51936 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.905206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:21.910597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdf60a-19ba-465a-9230-041e9c0cb5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.912289 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdf60a-19ba-465a-9230-041e9c0cb5cd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.912787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdf60a-19ba-465a-9230-041e9c0cb5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.913264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdf60a-19ba-465a-9230-041e9c0cb5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.921560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bf525-accd-4a67-9c70-03651057fe48 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:21.979370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:21.980043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:21.980361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:21.980647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:21.981447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:21.981755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.983938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:21.991624 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdf60a-19ba-465a-9230-041e9c0cb5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:21.993544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdf60a-19ba-465a-9230-041e9c0cb5cd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:22.002364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 353/687] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:22.002364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:22.067627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:22.118968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c0223-a259-4726-bde6-55e9e27c04b4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:22.120599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 335/688] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:22.121831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdf60a-19ba-465a-9230-041e9c0cb5cd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:22.172084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:22.172969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:22.173187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:22.174350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:22.186382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:22.188228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:22.197471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:22.211997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:22.213148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:22.214398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:22.214398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:22.214398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:22.214398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:22.214398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 354/689] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:22.214398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:22.238317 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdf60a-19ba-465a-9230-041e9c0cb5cd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:22.284812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:22.284812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:22.284812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:22.284812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:22.285203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=a367d904a4a44e91862da4aea28a123b) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:22.285203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:22.285330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:22.292533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 336/690] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:22 2022] GET /identity/v3/role_assignments?user.id=a367d904a4a44e91862da4aea28a123b&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:22.294595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:22.366209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa7084-75de-4cc6-bafe-cac70a1acfd0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:22.386461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:22.468055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:22.468910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:22.469211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:22.469469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:22.495141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:22.496679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:22.518792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc2251-db4b-4d06-9319-064d1c4c9473 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:22.519836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:22.520954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:22.522285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:22.522285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:22.522285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:22.522285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:22.522285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 355/691] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:22.528078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:22.590595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:22.591300 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:22.591587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:22.591868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:22.592644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:22.592945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:22.594343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:22.607364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:22.615750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 337/692] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:22.621767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:22.673272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925916-299e-44cb-82e6-7ed2aca2e7cb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:22.717820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:22.718508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:22.718796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:22.719079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:22.719825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:22.720150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:22.721667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:22.737044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 356/693] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:22.743957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:22.755110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:22.774936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ded6c-2fae-449a-91a5-31b322646049 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:22.832279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:22.833203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:22.833330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:22.833712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:22.847695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:22.849145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:22.878161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:22.880377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:22.882432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 338/694] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:04:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:22.887168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:22.938716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50959cb9-779c-40a7-8142-88ea999eaa63 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:22.970220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:23.019698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b041e28-c35f-469b-b58d-c0491410811a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:23.043809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.045173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.045465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.045742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.053888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.055367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:23.070579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:23.071519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:23.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 357/695] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:23.077748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:23.096372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca668a9-4a77-405e-83df-2ce2ffbc9c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.097057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca668a9-4a77-405e-83df-2ce2ffbc9c5e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.097340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca668a9-4a77-405e-83df-2ce2ffbc9c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.097616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca668a9-4a77-405e-83df-2ce2ffbc9c5e None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.098524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca668a9-4a77-405e-83df-2ce2ffbc9c5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:23.098779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca668a9-4a77-405e-83df-2ce2ffbc9c5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.101988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca668a9-4a77-405e-83df-2ce2ffbc9c5e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.135730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 339/696] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:04:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:23.137198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b6a3e-5cee-425a-8b4d-e890ecff00be None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.137489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b6a3e-5cee-425a-8b4d-e890ecff00be None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.137770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b6a3e-5cee-425a-8b4d-e890ecff00be None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.139806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 340/697] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:23.140573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b6a3e-5cee-425a-8b4d-e890ecff00be None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:23.148283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:23.209733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d373407-c93b-47db-a909-39f812f48347 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:23.246489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c9bd0-74fb-478f-b7ea-d53e5da9dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.247165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c9bd0-74fb-478f-b7ea-d53e5da9dc9e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.247504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c9bd0-74fb-478f-b7ea-d53e5da9dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.248363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c9bd0-74fb-478f-b7ea-d53e5da9dc9e None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.249309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c9bd0-74fb-478f-b7ea-d53e5da9dc9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:23.249650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c9bd0-74fb-478f-b7ea-d53e5da9dc9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.251222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c9bd0-74fb-478f-b7ea-d53e5da9dc9e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.264579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 358/698] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:23.264852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b6a3e-5cee-425a-8b4d-e890ecff00be None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:23.265889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe747b-078e-467f-bf54-4329673589ce None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.266186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe747b-078e-467f-bf54-4329673589ce None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.266467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe747b-078e-467f-bf54-4329673589ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.285596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e5fe747b-078e-467f-bf54-4329673589ce None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:23.286890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e5fe747b-078e-467f-bf54-4329673589ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:23.312202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fe24-16fc-444d-99b8-280aff438285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.313049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fe24-16fc-444d-99b8-280aff438285 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.313336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fe24-16fc-444d-99b8-280aff438285 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.313606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728fe24-16fc-444d-99b8-280aff438285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.313866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:23.362670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 359/699] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:23.363470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe747b-078e-467f-bf54-4329673589ce None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:23.423645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728fe24-16fc-444d-99b8-280aff438285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.425347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728fe24-16fc-444d-99b8-280aff438285 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.428411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:23.468368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe747b-078e-467f-bf54-4329673589ce None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:23.504132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.504802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.505087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.505387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.506203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=23cd2e48acd9491cb513274c8ce3641f) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:23.506517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.507984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.515063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 360/700] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:23 2022] GET /identity/v3/role_assignments?user.id=23cd2e48acd9491cb513274c8ce3641f&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:23.515933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:23.544973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 341/701] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 11:04:23.549774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:23.552645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fe24-16fc-444d-99b8-280aff438285 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:23.639203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f527d-ac95-4416-b2a1-564cfa287c5a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:23.676037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.676968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.677310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.677627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.678335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.680169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.685266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728fe24-16fc-444d-99b8-280aff438285 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:23.688214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:23.698059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:23.699310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:23.700460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 361/702] 10.222.0.17 () {56 vars in 1129 bytes} [Thu Jul 14 11:04:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:23.707878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:23.740720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.742148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.742640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.743155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.755176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.757150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:23.778586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:23.780173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:23.781096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:23.781096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:23.781096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:23.781096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:23.783641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 342/703] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:23.789527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:23.806968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:23.826691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f821ce7-198c-4693-8838-f69ea772a03c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:23.892475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8100a-7ff3-4b2b-b0a6-948837d33f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.893099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8100a-7ff3-4b2b-b0a6-948837d33f48 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.893382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8100a-7ff3-4b2b-b0a6-948837d33f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.893657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8100a-7ff3-4b2b-b0a6-948837d33f48 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.894369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8100a-7ff3-4b2b-b0a6-948837d33f48 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:23.894672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8100a-7ff3-4b2b-b0a6-948837d33f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.896072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8100a-7ff3-4b2b-b0a6-948837d33f48 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.901145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 362/704] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Jul 14 11:04:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:23.906921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9dac8-c212-4d49-b141-c42443f1864e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.906921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9dac8-c212-4d49-b141-c42443f1864e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.906921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9dac8-c212-4d49-b141-c42443f1864e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.909656 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 363/705] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:23.910389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b14b3-a8bb-4546-994e-7731a0639176 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:23.910813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9dac8-c212-4d49-b141-c42443f1864e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:23.957592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88764c1c-73f7-42db-b45c-c787c497d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:23.958269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88764c1c-73f7-42db-b45c-c787c497d252 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.958555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88764c1c-73f7-42db-b45c-c787c497d252 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.958822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88764c1c-73f7-42db-b45c-c787c497d252 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:23.959765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88764c1c-73f7-42db-b45c-c787c497d252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:23.960070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88764c1c-73f7-42db-b45c-c787c497d252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:23.962364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88764c1c-73f7-42db-b45c-c787c497d252 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:23.982600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 343/706] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:23.982600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90bbe8-d03f-4dd8-954e-bb59e68d85fb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:23.982600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90bbe8-d03f-4dd8-954e-bb59e68d85fb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:23.982600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90bbe8-d03f-4dd8-954e-bb59e68d85fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:24.003634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5d90bbe8-d03f-4dd8-954e-bb59e68d85fb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:24.005161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5d90bbe8-d03f-4dd8-954e-bb59e68d85fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:24.019731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:24.051696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9dac8-c212-4d49-b141-c42443f1864e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:24.085816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 344/707] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:24.086677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90bbe8-d03f-4dd8-954e-bb59e68d85fb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:24.087899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:24.088598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:24.088882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:24.089161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:24.089882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:24.090190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:24.091609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:24.097713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 364/708] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Jul 14 11:04:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:24.136150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:24.171166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:24.262407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90bbe8-d03f-4dd8-954e-bb59e68d85fb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:24.303778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:24.304647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:24.304927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:24.305196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:24.312072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd56fac-7d35-47ab-9d73-0f52ff4d53f3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:24.312594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:24.314148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:24.330881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:24.331861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:24.332868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:24.332868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:24.332868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:24.332868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:24.332868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:24.332868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:24.332868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:24.332868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:24.336479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 345/709] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:24.338012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:24.349370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:24.350180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:24.350465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:24.350744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:24.351150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:24.362506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:24.364035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:24.385195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:24.386196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:24.387150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:24.387150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:24.387150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:24.387150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:24.387150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 365/710] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:24.394290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:24.494744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69853978-afbb-4495-b093-2cda2b530088 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:24.512469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:24.553636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043071f6-10b1-4a8d-ba95-1008e2bb18f1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:24.569098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:24.570208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:24.570721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:24.571198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:24.572376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:24.572966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:24.574628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:24.590024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:24.590705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:24.590992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:24.591301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:24.592039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:24.592394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:24.593968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:24.603557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 346/711] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:24.608366 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 366/712] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:24.613439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:24.617127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:24.747413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:24.794086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0c1de-e000-492a-ac50-1071871f6c4a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:24.826611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e6a79-e9fc-4f72-8482-19b2f36eebc5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:24.871985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ecbba-bec2-455d-9aa8-bca8c99ce34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:24.872752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecbba-bec2-455d-9aa8-bca8c99ce34e None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:24.873037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecbba-bec2-455d-9aa8-bca8c99ce34e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:24.873313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ecbba-bec2-455d-9aa8-bca8c99ce34e None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:24.874037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ecbba-bec2-455d-9aa8-bca8c99ce34e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:24.875721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ecbba-bec2-455d-9aa8-bca8c99ce34e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:24.896995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:24.916556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf491cb6-9c7d-4e22-a98d-731b65d3cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:24.917233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf491cb6-9c7d-4e22-a98d-731b65d3cf73 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:24.917527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf491cb6-9c7d-4e22-a98d-731b65d3cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:24.917779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf491cb6-9c7d-4e22-a98d-731b65d3cf73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:24.918657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf491cb6-9c7d-4e22-a98d-731b65d3cf73 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=00b59b80b61a4dec8f4df2bc8a45d340) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:24.918972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf491cb6-9c7d-4e22-a98d-731b65d3cf73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:24.921060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf491cb6-9c7d-4e22-a98d-731b65d3cf73 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:24.948281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 367/713] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:24 2022] GET /identity/v3/role_assignments?user.id=00b59b80b61a4dec8f4df2bc8a45d340&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:24.950280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 347/714] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:04:24 2022] POST /identity/v3/users => generated 254 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:25.064745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236659-c695-4121-a302-a426dd5bc6e9 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:25.065247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236659-c695-4121-a302-a426dd5bc6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:25.065247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0236659-c695-4121-a302-a426dd5bc6e9 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:25.067605 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 368/715] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:25.073391 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b363e-c60f-4390-98d9-6e925b6549ee None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:25.073744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b363e-c60f-4390-98d9-6e925b6549ee None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:25.073937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b363e-c60f-4390-98d9-6e925b6549ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:25.092616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-473b363e-c60f-4390-98d9-6e925b6549ee None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:25.093850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-473b363e-c60f-4390-98d9-6e925b6549ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:25.204499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 348/716] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:25.247314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0236659-c695-4121-a302-a426dd5bc6e9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:25.367729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0236659-c695-4121-a302-a426dd5bc6e9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:25.417351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:25.418530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:25.418983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:25.419446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] PATH_INFO: `/v3/services/network` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:25.420341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:25.421977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:25.435037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:25.436410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:25.437457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:25.440962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 369/717] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:25 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:25.447340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b363e-c60f-4390-98d9-6e925b6549ee None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:25.506079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:25.577967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b363e-c60f-4390-98d9-6e925b6549ee None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:25.619042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edf2e9-ba15-4b46-b9c2-26df564fdd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:25.619706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edf2e9-ba15-4b46-b9c2-26df564fdd2c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:25.619985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edf2e9-ba15-4b46-b9c2-26df564fdd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:25.620327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edf2e9-ba15-4b46-b9c2-26df564fdd2c None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:25.621046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edf2e9-ba15-4b46-b9c2-26df564fdd2c None admin] RBAC: Adding query filter params (name=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:25.621349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edf2e9-ba15-4b46-b9c2-26df564fdd2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:25.623396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edf2e9-ba15-4b46-b9c2-26df564fdd2c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:25.629517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 349/718] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:25.635281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:25.722400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:25.774144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba3cfd-62ad-44bc-a018-9808c3ad9747 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:25.808455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8856fd3-d39b-4d83-a086-200dcd140d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:25.809123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856fd3-d39b-4d83-a086-200dcd140d8e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:25.809442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856fd3-d39b-4d83-a086-200dcd140d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:25.809697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8856fd3-d39b-4d83-a086-200dcd140d8e None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:25.810952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8856fd3-d39b-4d83-a086-200dcd140d8e None admin] RBAC: Adding query filter params (type=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:25.811213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8856fd3-d39b-4d83-a086-200dcd140d8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:25.813397 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8856fd3-d39b-4d83-a086-200dcd140d8e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:25.821457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 370/719] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:26.324158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a01bd-b6d0-436b-b727-3c6ce3f5b7ee None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:26.325154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a01bd-b6d0-436b-b727-3c6ce3f5b7ee None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:26.325154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a01bd-b6d0-436b-b727-3c6ce3f5b7ee None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:26.326376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 350/720] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:04:26.331899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0b263-62ae-4f93-b3a0-01375a2c933c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:26.332725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0b263-62ae-4f93-b3a0-01375a2c933c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:26.332725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0b263-62ae-4f93-b3a0-01375a2c933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:26.363909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-40d0b263-62ae-4f93-b3a0-01375a2c933c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:26.365153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-40d0b263-62ae-4f93-b3a0-01375a2c933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:26.461832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 371/721] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 11:04:26.489131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a01bd-b6d0-436b-b727-3c6ce3f5b7ee None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:26.666201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a01bd-b6d0-436b-b727-3c6ce3f5b7ee None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:26.683282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:26.705295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728fb4-ccd6-49ba-9e73-4f3ed2a0a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:26.706612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728fb4-ccd6-49ba-9e73-4f3ed2a0a780 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:26.706906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728fb4-ccd6-49ba-9e73-4f3ed2a0a780 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:26.707369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728fb4-ccd6-49ba-9e73-4f3ed2a0a780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:26.719628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728fb4-ccd6-49ba-9e73-4f3ed2a0a780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9a728fb4-ccd6-49ba-9e73-4f3ed2a0a780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:26.727950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:26.728932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:26.729792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 351/722] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:26.736237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0b263-62ae-4f93-b3a0-01375a2c933c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:26.823617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:26.920155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0b263-62ae-4f93-b3a0-01375a2c933c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:26.982099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbea05-7a1c-43aa-89d6-f1a3bba964b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:26.982784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbea05-7a1c-43aa-89d6-f1a3bba964b6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:26.983069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbea05-7a1c-43aa-89d6-f1a3bba964b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:26.983351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbea05-7a1c-43aa-89d6-f1a3bba964b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:26.984143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbea05-7a1c-43aa-89d6-f1a3bba964b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:26.984456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbea05-7a1c-43aa-89d6-f1a3bba964b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:26.985854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbea05-7a1c-43aa-89d6-f1a3bba964b6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:27.004717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 372/723] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:27.010675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728fb4-ccd6-49ba-9e73-4f3ed2a0a780 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:27.170750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775feb6e-1732-4985-9391-1bd0eb5ae619 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:27.170985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775feb6e-1732-4985-9391-1bd0eb5ae619 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:27.171349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775feb6e-1732-4985-9391-1bd0eb5ae619 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:27.173380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 373/724] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:27.191296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c4ab-a1f0-454a-b86a-19ddf7451470 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:27.191859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c4ab-a1f0-454a-b86a-19ddf7451470 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:27.192206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466c4ab-a1f0-454a-b86a-19ddf7451470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:27.200547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728fb4-ccd6-49ba-9e73-4f3ed2a0a780 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:27.222342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4466c4ab-a1f0-454a-b86a-19ddf7451470 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:27.225470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4466c4ab-a1f0-454a-b86a-19ddf7451470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:27.270918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:27.272587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:27.274676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:27.277890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:27.302873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:27.304999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:27.332848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:27.334322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:27.335516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:27.335516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:27.335516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:27.335516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:27.335516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 352/725] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:27.344137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:27.372204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 374/726] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:27.384130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:27.418279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466c4ab-a1f0-454a-b86a-19ddf7451470 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:27.477130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ba015-44a8-4ded-a0e2-6039ebab80f7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:27.537742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:27.538767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:27.539301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:27.539876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:27.541042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:27.541799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:27.544028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:27.561105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:27.561445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 353/727] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:27.570661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:27.668275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466c4ab-a1f0-454a-b86a-19ddf7451470 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:27.719807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd257ea-06fe-4289-9d85-4718f5231ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:27.720611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd257ea-06fe-4289-9d85-4718f5231ba9 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:27.720891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd257ea-06fe-4289-9d85-4718f5231ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:27.721167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd257ea-06fe-4289-9d85-4718f5231ba9 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:27.721898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd257ea-06fe-4289-9d85-4718f5231ba9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:27.725129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd257ea-06fe-4289-9d85-4718f5231ba9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:27.741697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:27.752155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 375/728] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:04:27 2022] POST /identity/v3/services => generated 251 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:27.752155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eff38-7253-4c76-abae-5ef1ca92f7e4 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:27.752155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eff38-7253-4c76-abae-5ef1ca92f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:27.752155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205eff38-7253-4c76-abae-5ef1ca92f7e4 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:27.755824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 376/729] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:27.760002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96564-fb48-44ae-918f-d7494d6b58d0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:27.760498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96564-fb48-44ae-918f-d7494d6b58d0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:27.760987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda96564-fb48-44ae-918f-d7494d6b58d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:27.781460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dc6e9-5e33-4599-8f23-4c5bca1f6281 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:27.787126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-eda96564-fb48-44ae-918f-d7494d6b58d0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:27.787126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-eda96564-fb48-44ae-918f-d7494d6b58d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:27.903315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:27.905883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:27.906165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:27.906437 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:27.930235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:27.931730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:27.949637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 377/730] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:27.960028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:27.962244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:27.965171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 354/731] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:27.971508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96564-fb48-44ae-918f-d7494d6b58d0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:28.000784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:28.022535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.119943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda96564-fb48-44ae-918f-d7494d6b58d0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:28.134888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29394c1b-2a21-4184-a7ec-a0c90d0341e5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:28.167563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:28.168282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.168571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.168850 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.169742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:28.170050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:28.171671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:28.184329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738025-6c07-42a5-b137-594cbff58578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:28.185953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738025-6c07-42a5-b137-594cbff58578 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.185953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738025-6c07-42a5-b137-594cbff58578 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.186157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec738025-6c07-42a5-b137-594cbff58578 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.201391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 378/732] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Jul 14 11:04:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:28.204255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:28.214472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec738025-6c07-42a5-b137-594cbff58578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ec738025-6c07-42a5-b137-594cbff58578 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:28.224937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:28.226149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:28.233022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 355/733] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:28.238344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738025-6c07-42a5-b137-594cbff58578 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:28.252516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.406142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.422973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec738025-6c07-42a5-b137-594cbff58578 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:28.426206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181ea50-9971-4f67-9ad0-bdba16e43b2d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:28.471445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a8ad3-6ac5-4868-ab14-8c9a7080c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:28.471657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff21b0b-b9fd-4ccc-8313-ff95ca946c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:28.472293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21b0b-b9fd-4ccc-8313-ff95ca946c34 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.472580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21b0b-b9fd-4ccc-8313-ff95ca946c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.472854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21b0b-b9fd-4ccc-8313-ff95ca946c34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.473197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8ad3-6ac5-4868-ab14-8c9a7080c4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.473652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8ad3-6ac5-4868-ab14-8c9a7080c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.474113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a8ad3-6ac5-4868-ab14-8c9a7080c4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.475285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8ad3-6ac5-4868-ab14-8c9a7080c4c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:28.475864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8ad3-6ac5-4868-ab14-8c9a7080c4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:28.477585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a8ad3-6ac5-4868-ab14-8c9a7080c4c6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:28.491659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 356/734] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:28.493488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda5937-7f2c-4e90-a67d-56fd01004a2c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.494023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda5937-7f2c-4e90-a67d-56fd01004a2c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.494475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda5937-7f2c-4e90-a67d-56fd01004a2c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.500469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 357/735] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:28.501709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda5937-7f2c-4e90-a67d-56fd01004a2c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:28.546468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21b0b-b9fd-4ccc-8313-ff95ca946c34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:28.548223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21b0b-b9fd-4ccc-8313-ff95ca946c34 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:28.588826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.626494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda5937-7f2c-4e90-a67d-56fd01004a2c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:28.643813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.659812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 379/736] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:28 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 11:04:28.659812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90765dc-e4cc-484d-8be1-928a88d9fffe None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.659812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90765dc-e4cc-484d-8be1-928a88d9fffe None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.659812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90765dc-e4cc-484d-8be1-928a88d9fffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.669067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d7163-5a38-4b86-b824-6a2eeaf9ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:28.670424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7163-5a38-4b86-b824-6a2eeaf9ced0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.670700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7163-5a38-4b86-b824-6a2eeaf9ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.670973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d7163-5a38-4b86-b824-6a2eeaf9ced0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.674872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f90765dc-e4cc-484d-8be1-928a88d9fffe None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:28.676179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f90765dc-e4cc-484d-8be1-928a88d9fffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:28.681949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d7163-5a38-4b86-b824-6a2eeaf9ced0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:28.683396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d7163-5a38-4b86-b824-6a2eeaf9ced0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d86d7163-5a38-4b86-b824-6a2eeaf9ced0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:28.703013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:28.704240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:28.705350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:28.705350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:28.705350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:28.705350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:28.709063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 358/737] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:28.710437 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a95d7-b3a3-4522-919c-e09043f253a4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.710732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a95d7-b3a3-4522-919c-e09043f253a4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.711097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a95d7-b3a3-4522-919c-e09043f253a4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.712332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 359/738] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:28.717034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a95d7-b3a3-4522-919c-e09043f253a4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:28.751178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 380/739] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:28.752803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90765dc-e4cc-484d-8be1-928a88d9fffe None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:28.859010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a95d7-b3a3-4522-919c-e09043f253a4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:28.869576 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90765dc-e4cc-484d-8be1-928a88d9fffe None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:28.879429 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.895436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:28.904907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:28.906037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.906326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.906602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.910189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf53a65-60dd-4d6c-9c31-271eac745561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:28.910858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53a65-60dd-4d6c-9c31-271eac745561 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.911143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53a65-60dd-4d6c-9c31-271eac745561 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.911419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf53a65-60dd-4d6c-9c31-271eac745561 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.912170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53a65-60dd-4d6c-9c31-271eac745561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:28.912479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53a65-60dd-4d6c-9c31-271eac745561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:28.913868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf53a65-60dd-4d6c-9c31-271eac745561 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:28.917563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:28.919075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:28.926323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 381/740] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:28.927601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2f27-0988-41d0-805e-5cb484b2ac5a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:28.927892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2f27-0988-41d0-805e-5cb484b2ac5a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:28.928190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2f27-0988-41d0-805e-5cb484b2ac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:28.942746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:28.943671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:28.949339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:28.949339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:28.949339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:28.949339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:28.949339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 360/741] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:28.949339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:28.949680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-66ce2f27-0988-41d0-805e-5cb484b2ac5a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:28.950531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-66ce2f27-0988-41d0-805e-5cb484b2ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:29.025592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 382/742] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 11:04:29.026484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2f27-0988-41d0-805e-5cb484b2ac5a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.072126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020f294-857c-43e1-ba01-02a6fdeb17aa None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.110435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d4d2-c6c9-46f7-982a-abc4e2733c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.111955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d4d2-c6c9-46f7-982a-abc4e2733c75 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.112460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d4d2-c6c9-46f7-982a-abc4e2733c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.112930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2d4d2-c6c9-46f7-982a-abc4e2733c75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.127022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2d4d2-c6c9-46f7-982a-abc4e2733c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:29.135957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2f27-0988-41d0-805e-5cb484b2ac5a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-76c2d4d2-c6c9-46f7-982a-abc4e2733c75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:29.137477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:29.138496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:29.139523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:29.141646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 361/743] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:29.142338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d4d2-c6c9-46f7-982a-abc4e2733c75 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.152315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:29.176760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:29.180080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.180918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.181204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.181507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.190983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:29.193154 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:29.207975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:29.209039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 383/744] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:29.209999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.261582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2d4d2-c6c9-46f7-982a-abc4e2733c75 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.299570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.300265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.300544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.300806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.301530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:29.301837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:29.303208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:29.315963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 362/745] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:29.317357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.327866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654eaad-2b52-49b7-ae69-d11a88eab422 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.362355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15bf0-46b3-4138-b7ef-727ee1b9135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.362940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15bf0-46b3-4138-b7ef-727ee1b9135f None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.363217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15bf0-46b3-4138-b7ef-727ee1b9135f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.363491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d15bf0-46b3-4138-b7ef-727ee1b9135f None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.364251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15bf0-46b3-4138-b7ef-727ee1b9135f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:29.365606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d15bf0-46b3-4138-b7ef-727ee1b9135f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:29.380983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 384/746] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:04:29 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:29.381614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15bf0-46b3-4138-b7ef-727ee1b9135f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.424924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:29.426144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:29.443599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e7afc-a2c0-4943-8ae3-fac25d371a05 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.490703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.491589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.491937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.492309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.493237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:29.493608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:29.495210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:29.509097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 363/747] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:29.510069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.523877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d15bf0-46b3-4138-b7ef-727ee1b9135f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.575043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.576328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.576614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.576907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.578176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:29.578176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:29.579795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:29.600504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 385/748] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:29.601351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.659157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67f82-e962-4900-a365-4f89017d38b9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.696871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:29.709818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423097f-3299-4a03-86d2-914b92b4f9a1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.710654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.712949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.713455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.713933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.722904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:29.725498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:29.743277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:29.744277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 364/749] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:29.745748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.753264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.754401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.754890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.755367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.758346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:29.772917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:29.775312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:29.800568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:29.801545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:29.802451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:29.802451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:29.802451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:29.802451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:29.806452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 386/750] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:29.807322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:29.864956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad862db-9f65-48fa-a5a4-ff755ce139cc None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:29.905849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:29.907051 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:29.907545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:29.908057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:29.922517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:29.924403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:29.945926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:29.946921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:29.947815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:29.947815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:29.947815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:29.947815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:29.950318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 365/751] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:29.951571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.028477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:30.047290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2526544-3fa5-4ded-87b9-ef84fc3e1c34 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.082628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.083302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708e5ae-8880-4fb2-83df-d03174e45fec None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.083731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.084239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.084658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.085601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:30.086071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.087858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.098218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:30.108737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 387/752] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:30.109917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.129163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.130228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.130520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.130799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.131536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:30.131844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.133275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.154702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 366/753] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:30.154702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.229616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba37ca-6377-4ef3-a017-2dd6c7ed1dda None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.267023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.267691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.267971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.268275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.268995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:30.269296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.270666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.283083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 388/754] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:30.284130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.290503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcd274-cb45-467e-a410-ab7cf5e79060 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.312847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:30.329060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a26a6-b9f9-4e2c-9a6a-ba43a1d87d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.329721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a26a6-b9f9-4e2c-9a6a-ba43a1d87d6d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.330012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a26a6-b9f9-4e2c-9a6a-ba43a1d87d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.330293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a26a6-b9f9-4e2c-9a6a-ba43a1d87d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.331126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a26a6-b9f9-4e2c-9a6a-ba43a1d87d6d None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=23cd2e48acd9491cb513274c8ce3641f) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:30.331442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a26a6-b9f9-4e2c-9a6a-ba43a1d87d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.332914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a26a6-b9f9-4e2c-9a6a-ba43a1d87d6d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.339058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 367/755] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:30 2022] GET /identity/v3/role_assignments?user.id=23cd2e48acd9491cb513274c8ce3641f&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:30.340683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91524e-016e-4ac2-9c2d-e165fb2f3816 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.340978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91524e-016e-4ac2-9c2d-e165fb2f3816 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.341802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91524e-016e-4ac2-9c2d-e165fb2f3816 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.347599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 368/756] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:30.347599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91524e-016e-4ac2-9c2d-e165fb2f3816 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.384478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:30.430370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269569d9-62b4-4c73-b552-ed0243c13090 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.483219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91524e-016e-4ac2-9c2d-e165fb2f3816 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.486929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfcf65-d13d-41e0-ac75-4e011c80e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.488082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfcf65-d13d-41e0-ac75-4e011c80e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.488541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfcf65-d13d-41e0-ac75-4e011c80e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.488990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfcf65-d13d-41e0-ac75-4e011c80e4b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.500004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfcf65-d13d-41e0-ac75-4e011c80e4b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.501911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfcf65-d13d-41e0-ac75-4e011c80e4b7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-01bfcf65-d13d-41e0-ac75-4e011c80e4b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:30.524730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:30.525786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:30.526827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 389/757] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:04:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:30.527939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510195b-fd7d-423b-b437-7b2b036fb689 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.528043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510195b-fd7d-423b-b437-7b2b036fb689 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.528325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510195b-fd7d-423b-b437-7b2b036fb689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.534831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.536073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.536794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.537272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.545549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.547150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3510195b-fd7d-423b-b437-7b2b036fb689 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:30.547554 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.548568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3510195b-fd7d-423b-b437-7b2b036fb689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:30.564182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:30.565155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:30.566061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:30.566061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:30.566061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:30.566061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:30.566061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:30.566061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:30.566061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:30.566061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:30.572239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 369/758] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:30.573711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.627438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:30.634760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 390/759] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:30.634760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510195b-fd7d-423b-b437-7b2b036fb689 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.696840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61146d5-63cd-4366-a1cc-d3f78a0c0084 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.703386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:30.737166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.738203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.738736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.739214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.740399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:30.740922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.742653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.761825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 370/760] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Jul 14 11:04:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:30.763562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.772707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510195b-fd7d-423b-b437-7b2b036fb689 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.810409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.811102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.811382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.811620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.812450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:30.812759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.814311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.832137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 391/761] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:30.832137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.877740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461fb7-ccfd-425d-8815-61e05704cb66 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.879729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:30.917785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.918987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.919499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.920078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:30.921078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:30.922677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:30.936920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da158b-c210-4154-af38-79ebb03ce469 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:30.939038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:30.939968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:30.940865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:30.944019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 371/762] 10.222.0.17 () {56 vars in 1129 bytes} [Thu Jul 14 11:04:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:30.945228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:30.947843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:30.974446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819b84-8cc8-49b0-bf80-243cac4b6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:30.975291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819b84-8cc8-49b0-bf80-243cac4b6b18 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:30.975476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819b84-8cc8-49b0-bf80-243cac4b6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:30.975738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819b84-8cc8-49b0-bf80-243cac4b6b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.051852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819b84-8cc8-49b0-bf80-243cac4b6b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.053396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819b84-8cc8-49b0-bf80-243cac4b6b18 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.066775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61a1b-1ebd-4de0-a3c8-9d6d232a6087 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.104588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8bd8e-03b6-48b9-83f7-06c2e4ae8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.105961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8bd8e-03b6-48b9-83f7-06c2e4ae8429 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.106459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8bd8e-03b6-48b9-83f7-06c2e4ae8429 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.106968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8bd8e-03b6-48b9-83f7-06c2e4ae8429 None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/00b59b80b61a4dec8f4df2bc8a45d340/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.109559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8bd8e-03b6-48b9-83f7-06c2e4ae8429 None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=00b59b80b61a4dec8f4df2bc8a45d340, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.111339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8bd8e-03b6-48b9-83f7-06c2e4ae8429 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.134777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 372/763] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:30 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/00b59b80b61a4dec8f4df2bc8a45d340/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:31.136193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8bd8e-03b6-48b9-83f7-06c2e4ae8429 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.195869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 392/764] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:04:31.201855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819b84-8cc8-49b0-bf80-243cac4b6b18 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.206860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:31.216312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:31.317320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819b84-8cc8-49b0-bf80-243cac4b6b18 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.352737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.353897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.354386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.354902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.366186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.367942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.374025 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8bd8e-03b6-48b9-83f7-06c2e4ae8429 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:31.387478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:31.388521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:31.389425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:31.389425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:31.389425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:31.389425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:31.391673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 393/765] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:31.396834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.409335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.409757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.410102 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.410379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.411084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:31.411388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.412796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.422724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 373/766] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:31.423920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.465356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:31.508529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae784bd-3616-4c33-8a6f-ffe0308ebfc3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.532698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:31.553948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.554825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.555200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.555545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.556405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:31.556787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.558234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.566172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9be9b-3a6d-4672-bae8-4a2149f5b92f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.572250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 394/767] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:31.578347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.627174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b2461-d3b5-4fd1-a881-0514ec0acc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.628043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2461-d3b5-4fd1-a881-0514ec0acc2b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.628360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2461-d3b5-4fd1-a881-0514ec0acc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.629465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b2461-d3b5-4fd1-a881-0514ec0acc2b None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.630196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b2461-d3b5-4fd1-a881-0514ec0acc2b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:31.630507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b2461-d3b5-4fd1-a881-0514ec0acc2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.631898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b2461-d3b5-4fd1-a881-0514ec0acc2b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.640728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 374/768] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:31.642039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d5498-1f18-4406-b172-cc564be8b5e6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.642332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d5498-1f18-4406-b172-cc564be8b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.642617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d5498-1f18-4406-b172-cc564be8b5e6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.644090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 375/769] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:31.648355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d5498-1f18-4406-b172-cc564be8b5e6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.715325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880734e-0aff-4dec-843a-ef0f7e1c4a3c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.749020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed38e63-c4ee-400c-a664-efa84ca4623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.749801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38e63-c4ee-400c-a664-efa84ca4623f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.750079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38e63-c4ee-400c-a664-efa84ca4623f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.750348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38e63-c4ee-400c-a664-efa84ca4623f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.756938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed38e63-c4ee-400c-a664-efa84ca4623f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.758592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed38e63-c4ee-400c-a664-efa84ca4623f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.760424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:31.770449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d5498-1f18-4406-b172-cc564be8b5e6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6ed38e63-c4ee-400c-a664-efa84ca4623f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:31.774282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:31.775178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:31.776079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 395/770] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:31.777188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37fb2-6f7b-4724-962d-9e16b23680e9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.777476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37fb2-6f7b-4724-962d-9e16b23680e9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.777746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf37fb2-6f7b-4724-962d-9e16b23680e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.795446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-edf37fb2-6f7b-4724-962d-9e16b23680e9 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:31.796661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-edf37fb2-6f7b-4724-962d-9e16b23680e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:31.820764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.821891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.822471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.822952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.824001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] RBAC: Adding query filter params (interface=public, service_id=e6c7b1597159417cb99527008720fa4b, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:31.824547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.826846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:31.835369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 376/771] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/endpoints?service_id=e6c7b1597159417cb99527008720fa4b&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:31.836458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.859488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:31.880231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 396/772] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:31.881142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37fb2-6f7b-4724-962d-9e16b23680e9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:31.946970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c8046-b72a-4753-9ae7-443c7babe645 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:31.983103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:31.984174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:31.984671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:31.985148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:31.986163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:31.986672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:31.988348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:32.000038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf37fb2-6f7b-4724-962d-9e16b23680e9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:32.002406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 377/773] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:32.003441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:32.028373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:32.036908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43504ddf-638d-4d4b-9502-73799a3ac7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:32.037585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504ddf-638d-4d4b-9502-73799a3ac7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:32.037868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504ddf-638d-4d4b-9502-73799a3ac7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:32.038145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504ddf-638d-4d4b-9502-73799a3ac7e5 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:32.038985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43504ddf-638d-4d4b-9502-73799a3ac7e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:32.041005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43504ddf-638d-4d4b-9502-73799a3ac7e5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:32.046825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 397/774] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:04:31 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:32.048023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43504ddf-638d-4d4b-9502-73799a3ac7e5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:32.107457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:32.125003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff83c7-c9b3-479b-afdb-947f5bf7499e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:32.195413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:32.196760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:32.197071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:32.197349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] PATH_INFO: `/v3/services/network` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:32.198592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:32.200336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:32.215585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:32.216902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:32.218005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 378/775] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:32 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:32.234545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:32.270415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43504ddf-638d-4d4b-9502-73799a3ac7e5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:32.310204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:32.311200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:32.311810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:32.312257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:32.313246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=e3152e449d7546ed92690a7b58ae027c) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:32.313714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:32.315465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:32.324403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 398/776] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:32 2022] GET /identity/v3/role_assignments?user.id=e3152e449d7546ed92690a7b58ae027c&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:32.354068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22425423-6042-4f58-ad5b-9e9de686b72d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:32.395249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:32.395872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:32.396184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:32.396467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:32.397198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:32.397506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:32.398945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:32.405679 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 379/777] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:32.411476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:32.476015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:32.565315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab7e2-f129-46e1-92cc-7de76c760db1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:32.600496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d13da1-19b0-4424-bcb2-7ef030cf34af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:32.601166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13da1-19b0-4424-bcb2-7ef030cf34af None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:32.601716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13da1-19b0-4424-bcb2-7ef030cf34af None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:32.602010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d13da1-19b0-4424-bcb2-7ef030cf34af None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:32.602724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d13da1-19b0-4424-bcb2-7ef030cf34af None admin] RBAC: Adding query filter params (type=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:32.603028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d13da1-19b0-4424-bcb2-7ef030cf34af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:32.604496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d13da1-19b0-4424-bcb2-7ef030cf34af None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:32.616809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 399/778] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:32.623149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:32.632724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:32.749561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08dc4-082a-4a14-9736-bc15d10eaa47 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:32.749861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08dc4-082a-4a14-9736-bc15d10eaa47 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:32.750044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08dc4-082a-4a14-9736-bc15d10eaa47 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:32.751543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 400/779] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:32.755418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dff60f-4e97-403e-b97f-25895cebdac9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:32.761940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7a38-da14-4938-9a4d-f68e9588b52c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:32.762226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7a38-da14-4938-9a4d-f68e9588b52c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:32.762496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7a38-da14-4938-9a4d-f68e9588b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:32.803339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1e0c7a38-da14-4938-9a4d-f68e9588b52c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:32.806132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1e0c7a38-da14-4938-9a4d-f68e9588b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:32.830435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:32.831111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:32.831394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:32.831669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:32.832563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] RBAC: Adding query filter params (interface=public, service_id=c21dd7b8216345b08855787975920679, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:32.832877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:32.834480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:32.849450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 380/780] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Jul 14 11:04:32 2022] GET /identity/v3/endpoints?service_id=c21dd7b8216345b08855787975920679&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:32.853136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:32.945943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 401/781] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:32.970913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:32.993801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c7a38-da14-4938-9a4d-f68e9588b52c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:33.035199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82fc2d-ec5d-4883-afbc-6d4b9e75417a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:33.061601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:33.091965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141adcca-77cc-4bfa-ade6-4dd5b4700583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:33.093538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141adcca-77cc-4bfa-ade6-4dd5b4700583 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:33.094029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141adcca-77cc-4bfa-ade6-4dd5b4700583 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:33.094545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141adcca-77cc-4bfa-ade6-4dd5b4700583 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:33.100266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141adcca-77cc-4bfa-ade6-4dd5b4700583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:33.100266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141adcca-77cc-4bfa-ade6-4dd5b4700583 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:33.108809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 381/782] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:04:32 2022] GET /identity/v3/services => generated 772 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:33.155152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c7a38-da14-4938-9a4d-f68e9588b52c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:33.202696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ec369-a79c-44b1-a86d-cc78acc4c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:33.203572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ec369-a79c-44b1-a86d-cc78acc4c022 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:33.203860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ec369-a79c-44b1-a86d-cc78acc4c022 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:33.204159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ec369-a79c-44b1-a86d-cc78acc4c022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:33.217459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ec369-a79c-44b1-a86d-cc78acc4c022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5b0ec369-a79c-44b1-a86d-cc78acc4c022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:33.225596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:33.226615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:33.227695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 402/783] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:33.235189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141adcca-77cc-4bfa-ade6-4dd5b4700583 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:33.372343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141adcca-77cc-4bfa-ade6-4dd5b4700583 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:33.411621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:33.412390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:33.412742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:33.413024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:33.413781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:33.414085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:33.415473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:33.416912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:33.424218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e6386-df26-4cea-a90a-e57e284e9637 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:33.424501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e6386-df26-4cea-a90a-e57e284e9637 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:33.424768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e6386-df26-4cea-a90a-e57e284e9637 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:33.426399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 403/784] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:33.427550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 382/785] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:33.431654 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ed2d-9157-41f4-8dfa-147d0bb1df45 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:33.432215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ed2d-9157-41f4-8dfa-147d0bb1df45 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:33.432498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9ed2d-9157-41f4-8dfa-147d0bb1df45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:33.433369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:33.470049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-39c9ed2d-9157-41f4-8dfa-147d0bb1df45 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:33.471276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-39c9ed2d-9157-41f4-8dfa-147d0bb1df45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:33.545915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0ce2a-80ed-4763-a1e2-d6fbbf22189a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:33.587286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:33.588499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:33.589753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:33.590254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:33.608239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:33.611102 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:33.626355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 404/786] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:33.643589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:33.644888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:33.645814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:33.645814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:33.645814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:33.645814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:33.654801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 383/787] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:33.660209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9ed2d-9157-41f4-8dfa-147d0bb1df45 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:33.693761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:33.695704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:33.783675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:33.828469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9ed2d-9157-41f4-8dfa-147d0bb1df45 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:33.859164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f130688-22c0-4fed-a721-da817a3bfaf7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:33.899914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6c0f0-eb56-440d-a8b8-f966c5cfd785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:33.900693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c0f0-eb56-440d-a8b8-f966c5cfd785 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:33.900977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c0f0-eb56-440d-a8b8-f966c5cfd785 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:33.901253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6c0f0-eb56-440d-a8b8-f966c5cfd785 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:33.912136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6c0f0-eb56-440d-a8b8-f966c5cfd785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9bf6c0f0-eb56-440d-a8b8-f966c5cfd785 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:33.920045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:33.921005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:33.921869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 384/788] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:33.927784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6c0f0-eb56-440d-a8b8-f966c5cfd785 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:33.932847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:33.933801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:33.934303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:33.935347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:33.936309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:33.936834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:33.938422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:33.967514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 405/789] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:33.972780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.032631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6c0f0-eb56-440d-a8b8-f966c5cfd785 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.064642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:34.068772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.069382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.069675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.069955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.070802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:34.071112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.072547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.083034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 385/790] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:34.088410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.145762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:34.167163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b66176-ec8d-4b8e-ba82-eb473e8dd2a6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.196024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcf200-b5d4-4379-911a-58e4f9fa9f64 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.231492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.232987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.233336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.233684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.234427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.235457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.235994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.236435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.242802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.244362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.248949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.250607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:34.259658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:34.260865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:34.262055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:34.263171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 406/791] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:34.268703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:34.272596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:34.273709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:34.274825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:34.274825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:34.274825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:34.274825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:34.276686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 386/792] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:34.282398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.320603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:34.375214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f20d-40a8-40e7-9291-97ec5431fbc9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.392842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d338d95-2ef7-4e36-983b-c5de985b0472 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.429392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.430395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.430882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.431305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.431472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.432138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.432494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.432642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:34.432912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.433245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.433886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:34.434262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.435653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.436424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.448760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 387/793] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:34.454314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.472223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 407/794] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:34.477709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.480582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:34.566930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ba715-a2e0-4d1d-a75e-d68ae00b759e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.584066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f3be4-bba1-4bbe-9bbb-68d0ff53e666 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.608140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:34.616567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.617436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.617730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.618011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.619924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.620886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.621249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.621589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.633313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.634857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.649014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.650494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:34.653197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:34.654649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:34.655557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:34.655557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:34.655557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:34.655557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:34.661167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 408/795] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:34.665334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:34.674219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:34.676396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:34.678630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 388/796] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:34.684954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.751601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:34.822091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490578-4f41-48ea-89d7-0939f9d0a4ef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.822330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3cd2-01f6-4f7f-ad5e-fc91e9cbefd0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.857412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.857779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f474a5-fe90-4f62-ba32-2d992970bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:34.858094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.858383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.858496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f474a5-fe90-4f62-ba32-2d992970bf9b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.858653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.858769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f474a5-fe90-4f62-ba32-2d992970bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.858987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f474a5-fe90-4f62-ba32-2d992970bf9b None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.859494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:34.859801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.859971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f474a5-fe90-4f62-ba32-2d992970bf9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:34.862871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f474a5-fe90-4f62-ba32-2d992970bf9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:34.862985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.863081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f474a5-fe90-4f62-ba32-2d992970bf9b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:34.873811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 409/797] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:34.879394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 389/798] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:34.879877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c23c-7fd6-4001-8a55-e5ee96b43e53 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:34.880254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.884298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c23c-7fd6-4001-8a55-e5ee96b43e53 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:34.884442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:34.884616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c23c-7fd6-4001-8a55-e5ee96b43e53 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:34.886384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 410/799] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:34.887740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c23c-7fd6-4001-8a55-e5ee96b43e53 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:34.988558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f20f27-60c6-441e-b13f-98e5b9f6238b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:34.994252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c23c-7fd6-4001-8a55-e5ee96b43e53 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:35.008144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:35.027090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242530c0-55d5-4169-9b41-a2449610c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.028121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242530c0-55d5-4169-9b41-a2449610c8dc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.028442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242530c0-55d5-4169-9b41-a2449610c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.029442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242530c0-55d5-4169-9b41-a2449610c8dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.030929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6748e-0c2d-4353-b6b3-4e0ad5191c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.031576 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6748e-0c2d-4353-b6b3-4e0ad5191c74 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.031855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6748e-0c2d-4353-b6b3-4e0ad5191c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.032171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6748e-0c2d-4353-b6b3-4e0ad5191c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.038449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242530c0-55d5-4169-9b41-a2449610c8dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:35.039989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242530c0-55d5-4169-9b41-a2449610c8dc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-242530c0-55d5-4169-9b41-a2449610c8dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:35.055452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:35.056431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:35.057313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 390/800] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:35.058235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079ef9-aef2-4e3f-9320-dc6c91e0f32f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.058235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079ef9-aef2-4e3f-9320-dc6c91e0f32f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.058739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6079ef9-aef2-4e3f-9320-dc6c91e0f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.076500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b6079ef9-aef2-4e3f-9320-dc6c91e0f32f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:35.077922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b6079ef9-aef2-4e3f-9320-dc6c91e0f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:35.111423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6748e-0c2d-4353-b6b3-4e0ad5191c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:35.112922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6748e-0c2d-4353-b6b3-4e0ad5191c74 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:35.135910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:35.148733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 391/801] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:35.157701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dda33-db19-4ddf-94e8-a8bc0034a4a0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.157990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dda33-db19-4ddf-94e8-a8bc0034a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.158273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dda33-db19-4ddf-94e8-a8bc0034a4a0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.159778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 392/802] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:35.160433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dda33-db19-4ddf-94e8-a8bc0034a4a0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:35.226134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 411/803] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:04:35.228621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52880e2a-814c-4ecd-95c5-a35083b780d9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.228977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52880e2a-814c-4ecd-95c5-a35083b780d9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.229326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52880e2a-814c-4ecd-95c5-a35083b780d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.248316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-52880e2a-814c-4ecd-95c5-a35083b780d9 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:35.249516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-52880e2a-814c-4ecd-95c5-a35083b780d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:35.259133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:35.280397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dda33-db19-4ddf-94e8-a8bc0034a4a0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:35.320815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.321483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.321768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.322046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.322839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:35.323146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:35.324634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:35.336135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 412/804] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:35.336135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52880e2a-814c-4ecd-95c5-a35083b780d9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:35.337565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 393/805] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:35.338170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:35.400049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:35.447433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52880e2a-814c-4ecd-95c5-a35083b780d9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:35.485587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c97be9-3492-4ac7-9ef0-66db3a4de6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.486630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97be9-3492-4ac7-9ef0-66db3a4de6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.486743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97be9-3492-4ac7-9ef0-66db3a4de6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.487097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c97be9-3492-4ac7-9ef0-66db3a4de6f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.499787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c97be9-3492-4ac7-9ef0-66db3a4de6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c2c97be9-3492-4ac7-9ef0-66db3a4de6f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:35.507746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:35.509016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 413/806] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:35.510389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c97be9-3492-4ac7-9ef0-66db3a4de6f5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:35.518315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:35.578023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7058-50d4-4016-9158-d4f545bcf4e6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:35.613430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.614231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.614512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.614791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.626142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:35.627632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:35.628480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c97be9-3492-4ac7-9ef0-66db3a4de6f5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:35.646006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:35.647249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:35.648223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:35.648223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:35.648223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:35.648223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:35.648223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 394/807] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:35.648507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:35.670528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc95cc1-cfc7-4425-b9a5-25e1dd9a589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.671545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc95cc1-cfc7-4425-b9a5-25e1dd9a589a None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.671827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc95cc1-cfc7-4425-b9a5-25e1dd9a589a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.672205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc95cc1-cfc7-4425-b9a5-25e1dd9a589a None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/23cd2e48acd9491cb513274c8ce3641f/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.674239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc95cc1-cfc7-4425-b9a5-25e1dd9a589a None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=23cd2e48acd9491cb513274c8ce3641f, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:35.675796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc95cc1-cfc7-4425-b9a5-25e1dd9a589a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:35.704141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 414/808] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:35 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/23cd2e48acd9491cb513274c8ce3641f/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:35.704141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc95cc1-cfc7-4425-b9a5-25e1dd9a589a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:35.777067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf940-c4de-46e7-85df-152d5ac13d20 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:35.778344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:35.780370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:35.819261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.820110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.820424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.820699 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.821366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:35.822767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:35.827389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc95cc1-cfc7-4425-b9a5-25e1dd9a589a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:35.835698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:35.836793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:35.843060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 395/809] 10.222.0.17 () {56 vars in 1129 bytes} [Thu Jul 14 11:04:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:35.844205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:35.880066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002f1df-dccf-4db0-a717-6611e5f56340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.880866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002f1df-dccf-4db0-a717-6611e5f56340 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.881813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002f1df-dccf-4db0-a717-6611e5f56340 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.881813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002f1df-dccf-4db0-a717-6611e5f56340 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.882160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002f1df-dccf-4db0-a717-6611e5f56340 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:35.882463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002f1df-dccf-4db0-a717-6611e5f56340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:35.883833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002f1df-dccf-4db0-a717-6611e5f56340 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:35.892951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 415/810] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:35.894268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185daeb4-b7c1-4f92-b868-fae7119e4a69 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.894555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185daeb4-b7c1-4f92-b868-fae7119e4a69 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.894829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185daeb4-b7c1-4f92-b868-fae7119e4a69 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.900084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 416/811] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:35.900084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185daeb4-b7c1-4f92-b868-fae7119e4a69 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:35.956161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6088f7f-b069-4e0a-985e-a52f62796dae None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:35.993793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:35.994467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:35.994748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:35.995206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:35.995739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:35.996047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:35.997995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.005679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185daeb4-b7c1-4f92-b868-fae7119e4a69 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.010686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 396/812] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:36.011591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.037255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:36.041602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:36.048875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02fde7-cfbb-4c14-aa2e-5b6a8f0c9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.049544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02fde7-cfbb-4c14-aa2e-5b6a8f0c9603 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.049829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02fde7-cfbb-4c14-aa2e-5b6a8f0c9603 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.050106 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02fde7-cfbb-4c14-aa2e-5b6a8f0c9603 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.050821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02fde7-cfbb-4c14-aa2e-5b6a8f0c9603 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:36.051826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02fde7-cfbb-4c14-aa2e-5b6a8f0c9603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.052567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02fde7-cfbb-4c14-aa2e-5b6a8f0c9603 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.057198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 417/813] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Jul 14 11:04:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:36.057198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3277700-83d9-48d3-bfae-16a67869f1b3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.057198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3277700-83d9-48d3-bfae-16a67869f1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.057198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3277700-83d9-48d3-bfae-16a67869f1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.078910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b3277700-83d9-48d3-bfae-16a67869f1b3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:36.080093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b3277700-83d9-48d3-bfae-16a67869f1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:36.124246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f11a0-38d1-4142-a117-65ed5abbe8a5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.150931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 418/814] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:36.151772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3277700-83d9-48d3-bfae-16a67869f1b3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.171218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.172435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.172916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.173377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.185606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.187061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:36.204806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:36.206063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:36.207318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:36.207318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:36.207318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:36.207318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:36.208264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 397/815] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:36.209650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.267970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3277700-83d9-48d3-bfae-16a67869f1b3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.295601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:36.297563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:36.313616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.314418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.314702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.314978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.319711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23f062-4406-4205-aa00-710005f9c5f0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.322117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.323569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:36.337983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:36.338923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:36.339811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 419/816] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:36.340339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.360184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.361144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.361603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.362067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.362960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:36.363438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.365008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.370188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 398/817] 10.222.0.17 () {56 vars in 1124 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:36.371134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.460069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ace6-6ff0-48ea-8ae7-d2aac35a8a1f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.480712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640e23-a2a7-47b3-988d-45a2d6545dce None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.499789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.501048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.501340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.501834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.502442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.503830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:36.516600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:36.517600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:36.518437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 420/818] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:36.519227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.524547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.525242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.525504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.525777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.529978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:36.529978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.529978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.542273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 399/819] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:36.543258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.546106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:36.578316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:36.636425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e2e64-372d-4012-a8db-baa819473ee3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.653060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c67619-9bf1-4566-a867-f0582c1afe91 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.671586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.672285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.672632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.672879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.673652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:36.673966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.675408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.689185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1319e34-28bb-4ea1-a012-2dcd60d525a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.689663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 421/820] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:36.690555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.695036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1319e34-28bb-4ea1-a012-2dcd60d525a4 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.695332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1319e34-28bb-4ea1-a012-2dcd60d525a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.695615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1319e34-28bb-4ea1-a012-2dcd60d525a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.696392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1319e34-28bb-4ea1-a012-2dcd60d525a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.697830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1319e34-28bb-4ea1-a012-2dcd60d525a4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.728681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 400/821] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:04:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:36.730003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1319e34-28bb-4ea1-a012-2dcd60d525a4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.807150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a198cc-64dc-4b05-b320-2ff65573fdde None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.810204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:36.814800 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:36.866526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.867205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.867564 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.867761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.868539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] RBAC: Adding query filter params (name=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:36.868846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.870256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.870702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1319e34-28bb-4ea1-a012-2dcd60d525a4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:36.875892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 422/822] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:36.876797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:36.913849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:36.915070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:36.915070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:36.915320 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:36.924610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:36.927660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:36.944783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:36.945814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 401/823] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:36.947459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:37.000218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a561a9-caa1-4faa-9bbf-2481b53a8604 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:37.045435 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:37.046542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.047027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.047525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.048538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=00b59b80b61a4dec8f4df2bc8a45d340) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:37.048860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:37.051019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:37.064381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 423/824] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/role_assignments?user.id=00b59b80b61a4dec8f4df2bc8a45d340&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:37.065894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:37.083753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132efcde-d507-4e7d-b1fc-a1e42ea5affd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:37.120582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:37.127812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:37.129445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.129977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.130484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.131443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] RBAC: Adding query filter params (type=network) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:37.131975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:37.134079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:37.139136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:37.142567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 402/825] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:37.148252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:37.296356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172a7e9-7e53-4e73-8185-4c678c9890e5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:37.334774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d3ea6-86ae-4fac-be0d-38eaaea1e849 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:37.341988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:37.342881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.343313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.343741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.345323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:37.345807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:37.347407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:37.373955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 424/826] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Jul 14 11:04:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:37.380145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:37.389608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72d48b-a370-4c3e-b759-5e55f970b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:37.390294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72d48b-a370-4c3e-b759-5e55f970b6dd None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.390728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72d48b-a370-4c3e-b759-5e55f970b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.391007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72d48b-a370-4c3e-b759-5e55f970b6dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.391767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72d48b-a370-4c3e-b759-5e55f970b6dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:37.393191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb72d48b-a370-4c3e-b759-5e55f970b6dd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:37.417261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 403/827] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:04:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:37.481325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:37.498038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f5c4e-76da-438a-8db2-0c24f6bc29a3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:37.544957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:37.545780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.546063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.546341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.558083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:37.560348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:37.581035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:37.582158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:37.583267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:37.583267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:37.583267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:37.583267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:37.583267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 425/828] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:37.589548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72d48b-a370-4c3e-b759-5e55f970b6dd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:37.660659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:37.718325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72d48b-a370-4c3e-b759-5e55f970b6dd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:37.753546 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ed8a-d6e1-4777-ba98-94a48c7e9e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:37.754381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ed8a-d6e1-4777-ba98-94a48c7e9e1e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.754673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ed8a-d6e1-4777-ba98-94a48c7e9e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.754953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ed8a-d6e1-4777-ba98-94a48c7e9e1e None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.755693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2ed8a-d6e1-4777-ba98-94a48c7e9e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:37.756003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2ed8a-d6e1-4777-ba98-94a48c7e9e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:37.757426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2ed8a-d6e1-4777-ba98-94a48c7e9e1e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:37.770652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 404/829] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:37.776306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:37.890414 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2d31c-b780-4d1e-86b6-4bd56142ac3a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:37.913513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e064b-c380-4ac5-a526-69bb75aaedc6 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.914022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e064b-c380-4ac5-a526-69bb75aaedc6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.914101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e064b-c380-4ac5-a526-69bb75aaedc6 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.915911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 405/830] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:04:37.923108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547df60-c868-408a-87ec-710099a90feb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.923394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547df60-c868-408a-87ec-710099a90feb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.923672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547df60-c868-408a-87ec-710099a90feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.942096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:37.943267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:37.943782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:37.944330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:37.946718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:37.946851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5547df60-c868-408a-87ec-710099a90feb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:37.947947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5547df60-c868-408a-87ec-710099a90feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:37.952538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:37.954057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:37.969547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:37.970567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:37.971477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 426/831] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:37.985071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:38.027992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 406/832] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:38.052138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547df60-c868-408a-87ec-710099a90feb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:38.091262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:38.116714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b273aa-1508-4e62-9880-af587e060d27 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:38.162063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:38.162685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:38.162970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:38.163386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:38.164388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:38.165481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:38.167087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:38.174806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547df60-c868-408a-87ec-710099a90feb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:38.182159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 427/833] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:38.189006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:38.218665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf5515-4819-4e40-9b63-d775b00e238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:38.219817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf5515-4819-4e40-9b63-d775b00e238d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:38.220212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf5515-4819-4e40-9b63-d775b00e238d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:38.220559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf5515-4819-4e40-9b63-d775b00e238d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:38.237018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf5515-4819-4e40-9b63-d775b00e238d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4edf5515-4819-4e40-9b63-d775b00e238d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:38.247119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:38.248655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:38.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 407/834] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:38.255620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:38.257235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf5515-4819-4e40-9b63-d775b00e238d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:38.304454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d521f18-6a4d-4bdb-a872-c8651eb540f8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:38.342337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa456eb-6d9e-4c18-945f-04538c9e5c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:38.343559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa456eb-6d9e-4c18-945f-04538c9e5c4c None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:38.344138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa456eb-6d9e-4c18-945f-04538c9e5c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:38.344619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa456eb-6d9e-4c18-945f-04538c9e5c4c None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/e3152e449d7546ed92690a7b58ae027c/roles/abfe24af6ff444fcbd747639e12c2a73` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:38.362435 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa456eb-6d9e-4c18-945f-04538c9e5c4c None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=e3152e449d7546ed92690a7b58ae027c, role_id=abfe24af6ff444fcbd747639e12c2a73)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:38.363045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:38.365705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa456eb-6d9e-4c18-945f-04538c9e5c4c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:38.377957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf5515-4819-4e40-9b63-d775b00e238d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:38.383978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 428/835] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:38 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/e3152e449d7546ed92690a7b58ae027c/roles/abfe24af6ff444fcbd747639e12c2a73 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:38.422881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:38.423484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:38.423765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:38.424039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:38.424833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:38.425140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:38.426540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:38.437356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 408/836] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:38.443607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa456eb-6d9e-4c18-945f-04538c9e5c4c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:38.562814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa456eb-6d9e-4c18-945f-04538c9e5c4c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:38.565303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:38.605599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:38.606408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:38.607284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:38.607563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:38.619356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:38.620883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:38.641571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:38.642558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:38.643459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:38.643459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:38.643459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:38.643459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:38.643459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 429/837] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:38.648605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:38.753873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595d59-1dc8-4168-a7b3-da18210320a0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:38.787784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:38.788501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:38.788784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:38.789059 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:38.789790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:38.790097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:38.791483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:38.809125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 409/838] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:38.811057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:38.914443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c449c7-e874-4426-9f6f-4dcbd54fe541 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:38.950553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0c54f-ac83-4001-8173-2fff686ce4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:38.951711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0c54f-ac83-4001-8173-2fff686ce4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:38.952250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0c54f-ac83-4001-8173-2fff686ce4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:38.952729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0c54f-ac83-4001-8173-2fff686ce4c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:38.960530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0c54f-ac83-4001-8173-2fff686ce4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:38.962252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0c54f-ac83-4001-8173-2fff686ce4c7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6ee0c54f-ac83-4001-8173-2fff686ce4c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:38.978419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:38.979416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 11:04:38.980402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:38.987961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 430/839] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:04:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:38.989595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.003772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:39.047980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1739d-2c62-481c-a9b5-a3745711d859 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.048302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1739d-2c62-481c-a9b5-a3745711d859 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.048491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1739d-2c62-481c-a9b5-a3745711d859 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.049862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 431/840] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:39.055117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5756-fb61-4e74-a548-1f683619a13d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.055513 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5756-fb61-4e74-a548-1f683619a13d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.055803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a5756-fb61-4e74-a548-1f683619a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.074109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-784a5756-fb61-4e74-a548-1f683619a13d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:39.075456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-784a5756-fb61-4e74-a548-1f683619a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:39.090777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:39.101031 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da810d79-b11d-482e-8b0b-89501ceecc24 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:39.139305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:39.139981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.140323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.140603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.141442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:39.141748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:39.143189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:39.167625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 432/842] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:39.167815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 410/842] 10.222.0.17 () {56 vars in 1135 bytes} [Thu Jul 14 11:04:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:39.169671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.192704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5756-fb61-4e74-a548-1f683619a13d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.243619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:39.281978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d77f7-c198-40f4-8b61-7e073887d833 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:39.322608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347fd95-e0be-4e26-852d-e9fe5547ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:39.323167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347fd95-e0be-4e26-852d-e9fe5547ea46 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.323451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347fd95-e0be-4e26-852d-e9fe5547ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.323726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347fd95-e0be-4e26-852d-e9fe5547ea46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.331918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a5756-fb61-4e74-a548-1f683619a13d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:39.374780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:39.376072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.376673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.377077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.377738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:39.379879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:39.396441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:39.397467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:39.398345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 433/843] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:39.405561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.407600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347fd95-e0be-4e26-852d-e9fe5547ea46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:39.409285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347fd95-e0be-4e26-852d-e9fe5547ea46 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:39.420674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:39.491821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:39.536203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 411/844] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:04:39.540920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347fd95-e0be-4e26-852d-e9fe5547ea46 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.553420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf63ce-292e-4cc3-8657-0221c178b728 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:39.593142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b8869-d146-41a4-b00b-3a3e64d8bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:39.594134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b8869-d146-41a4-b00b-3a3e64d8bc8b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.594569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b8869-d146-41a4-b00b-3a3e64d8bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.595020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b8869-d146-41a4-b00b-3a3e64d8bc8b None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.595894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b8869-d146-41a4-b00b-3a3e64d8bc8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:39.596390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b8869-d146-41a4-b00b-3a3e64d8bc8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:39.597784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b8869-d146-41a4-b00b-3a3e64d8bc8b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:39.603197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 434/845] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:39.604779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec19f86-a16b-4630-bfdb-385a7086605d None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.605072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec19f86-a16b-4630-bfdb-385a7086605d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.605351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec19f86-a16b-4630-bfdb-385a7086605d None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.607449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 435/846] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:39.612636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec19f86-a16b-4630-bfdb-385a7086605d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.651777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347fd95-e0be-4e26-852d-e9fe5547ea46 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:39.688468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22bc8f-4af6-4d85-bf18-268b47f37228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:39.689262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22bc8f-4af6-4d85-bf18-268b47f37228 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.689551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22bc8f-4af6-4d85-bf18-268b47f37228 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.689824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22bc8f-4af6-4d85-bf18-268b47f37228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.694797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:39.700717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22bc8f-4af6-4d85-bf18-268b47f37228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:39.702157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22bc8f-4af6-4d85-bf18-268b47f37228 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ca22bc8f-4af6-4d85-bf18-268b47f37228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:39.720550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:39.721490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:39.723003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:39.723003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:39.723003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:39.723003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:39.723003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 412/847] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:39.723297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc04c-6273-4f33-b40f-5f94a3dc7a4b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.723514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc04c-6273-4f33-b40f-5f94a3dc7a4b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.723740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc04c-6273-4f33-b40f-5f94a3dc7a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.727697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec19f86-a16b-4630-bfdb-385a7086605d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:39.740425 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-486dc04c-6273-4f33-b40f-5f94a3dc7a4b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:39.741600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-486dc04c-6273-4f33-b40f-5f94a3dc7a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:39.756834 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:39.766658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:39.767662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.768196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.768434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.769258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:39.769477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:39.770831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:39.775504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 436/848] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:39 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:39.776086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.837780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 413/849] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:39.859808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dc04c-6273-4f33-b40f-5f94a3dc7a4b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.890400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592779f-fd79-4750-b7ff-5532b90ff384 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:39.929357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:39.930028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:39.931239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:39.931239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:39.931417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:39.931586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:39.933079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:39.939920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:39.947184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 437/850] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:39.951917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:39.979144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dc04c-6273-4f33-b40f-5f94a3dc7a4b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:40.016854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:40.017670 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.017947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.018214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.018872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:40.020275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:40.033636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:40.034715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:40.035727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 414/851] 10.222.0.17 () {56 vars in 1132 bytes} [Thu Jul 14 11:04:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:40.042137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:40.060907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:40.094120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbee7e0-04d6-47d3-ad55-7daa282a86f9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:40.129952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:40.131185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.131686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.132190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.140088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:40.141858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:40.151189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad4846-8ffd-4b7d-9dd9-8d10b6e075d5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:40.157600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:40.158500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:40.159417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:40.159417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:40.159417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:40.159417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:40.159417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:40.159417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:40.159417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:40.159417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:40.162045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 438/852] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:40.169512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:40.199678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:40.201963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.202637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.203250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.204438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:40.205351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:40.207479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:40.220119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 415/853] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:40.222498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:40.241947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:40.301221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777ceab-2804-401b-8916-893d3a415d99 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:40.323980 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:40.338731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:40.339790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.339919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.340301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.341764 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:40.342164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:40.343707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:40.350011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3491ff7-3b87-417b-a054-3605190a5aa5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:40.360199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 439/854] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:40.362803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:40.390801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a37e80-c764-49c1-8799-144ca50b3885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:40.391820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a37e80-c764-49c1-8799-144ca50b3885 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.392336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a37e80-c764-49c1-8799-144ca50b3885 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.392831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a37e80-c764-49c1-8799-144ca50b3885 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.393738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a37e80-c764-49c1-8799-144ca50b3885 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:40.394238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a37e80-c764-49c1-8799-144ca50b3885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:40.395813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a37e80-c764-49c1-8799-144ca50b3885 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:40.401056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 416/855] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:40.484506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de91383-1c68-412f-8fb3-eae38bbf68e9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:40.511870 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:40.546614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203f988-098a-416f-ae8c-b97842bb7876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:40.547543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f988-098a-416f-ae8c-b97842bb7876 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.547973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f988-098a-416f-ae8c-b97842bb7876 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.548472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203f988-098a-416f-ae8c-b97842bb7876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.549525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203f988-098a-416f-ae8c-b97842bb7876 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=23cd2e48acd9491cb513274c8ce3641f) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:40.550024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203f988-098a-416f-ae8c-b97842bb7876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:40.551650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203f988-098a-416f-ae8c-b97842bb7876 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:40.559317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 440/856] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:40 2022] GET /identity/v3/role_assignments?user.id=23cd2e48acd9491cb513274c8ce3641f&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:40.566368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1bd2-90e5-4e4c-a072-f9f0b73703a2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.566844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1bd2-90e5-4e4c-a072-f9f0b73703a2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.567082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1bd2-90e5-4e4c-a072-f9f0b73703a2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.568569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 417/857] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:40.574617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e692-22f1-4531-8a09-895ad7b774e7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.575009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e692-22f1-4531-8a09-895ad7b774e7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.575944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e692-22f1-4531-8a09-895ad7b774e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.594765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bfd7e692-22f1-4531-8a09-895ad7b774e7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:40.596167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bfd7e692-22f1-4531-8a09-895ad7b774e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:40.675198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 441/858] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:40.699193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1bd2-90e5-4e4c-a072-f9f0b73703a2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:40.807895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1bd2-90e5-4e4c-a072-f9f0b73703a2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:40.843556 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1da3e-e31a-4609-9db3-c9ad3915de49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:40.844504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1da3e-e31a-4609-9db3-c9ad3915de49 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:40.844788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1da3e-e31a-4609-9db3-c9ad3915de49 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:40.845063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1da3e-e31a-4609-9db3-c9ad3915de49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:40.856304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1da3e-e31a-4609-9db3-c9ad3915de49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-13f1da3e-e31a-4609-9db3-c9ad3915de49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:40.864295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:40.865234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:40.866103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 418/859] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:40.871808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e692-22f1-4531-8a09-895ad7b774e7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:40.983192 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e692-22f1-4531-8a09-895ad7b774e7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:40.999912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:41.022252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:41.023002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:41.023286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:41.023567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:41.024416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:41.024729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:41.026122 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:41.035602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 442/860] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:41.041370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1da3e-e31a-4609-9db3-c9ad3915de49 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:41.047311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:41.156755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1da3e-e31a-4609-9db3-c9ad3915de49 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:41.202355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:41.203184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:41.203460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:41.203730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:41.219746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:41.221228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:41.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:41.241072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:41.241967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:41.241967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:41.241967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:41.241967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:41.241967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 419/861] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:41.247961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:41.354499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761faa-bf00-46c6-844e-ada513847305 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:41.390349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:41.391025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:41.391312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:41.391587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:41.392339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:41.392645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:41.394021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:41.406830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 443/862] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:41.412452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:41.474729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:41.550632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba7a4-407d-4a44-a446-f0e0dcf14fbe None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:41.606849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:41.607666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:41.607942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:41.608247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:41.616573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:41.618035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:41.634762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:41.635771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:41.637204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 420/863] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:04:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:41.642649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:41.699871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:41.769849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcde217-bb84-4cb4-a6cb-00b8bd37cde5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:41.812582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc974da-42b6-43ad-8883-6a1448a2a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:41.813211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc974da-42b6-43ad-8883-6a1448a2a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:41.813494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc974da-42b6-43ad-8883-6a1448a2a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:41.813769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc974da-42b6-43ad-8883-6a1448a2a7c1 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:41.814688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc974da-42b6-43ad-8883-6a1448a2a7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:41.814995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc974da-42b6-43ad-8883-6a1448a2a7c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:41.816824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc974da-42b6-43ad-8883-6a1448a2a7c1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:41.842283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 444/864] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Jul 14 11:04:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:41.848408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:41.910728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a48ec-719f-4a61-b079-70f0a9328472 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:41.911041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a48ec-719f-4a61-b079-70f0a9328472 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:41.911280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a48ec-719f-4a61-b079-70f0a9328472 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:41.912894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 445/865] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:41.917910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8eb1c-33b8-47da-99fb-600826aca67d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:41.918194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8eb1c-33b8-47da-99fb-600826aca67d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:41.918470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8eb1c-33b8-47da-99fb-600826aca67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:41.936001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fcb8eb1c-33b8-47da-99fb-600826aca67d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:41.937259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fcb8eb1c-33b8-47da-99fb-600826aca67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:41.964594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeadca-6a1e-4409-908c-ebf0b3da2e6e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:41.978724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:42.001028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04f1d6-dc75-4bdd-a06c-0758cbaa07c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:42.001800 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f1d6-dc75-4bdd-a06c-0758cbaa07c1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.002154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f1d6-dc75-4bdd-a06c-0758cbaa07c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.002580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f1d6-dc75-4bdd-a06c-0758cbaa07c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.021104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 446/866] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:42.035780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8eb1c-33b8-47da-99fb-600826aca67d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:42.062385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:42.072750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04f1d6-dc75-4bdd-a06c-0758cbaa07c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:42.074224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04f1d6-dc75-4bdd-a06c-0758cbaa07c1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:42.145700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8eb1c-33b8-47da-99fb-600826aca67d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:42.180141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 421/867] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:04:42.182753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04f1d6-dc75-4bdd-a06c-0758cbaa07c1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:42.190406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b359-81d6-49cd-9599-0fd685df3b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:42.191174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b359-81d6-49cd-9599-0fd685df3b77 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.191795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b359-81d6-49cd-9599-0fd685df3b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.192163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943b359-81d6-49cd-9599-0fd685df3b77 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.193126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b359-81d6-49cd-9599-0fd685df3b77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:42.195068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943b359-81d6-49cd-9599-0fd685df3b77 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:42.202794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:42.216337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 447/868] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:04:42 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:42.322086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04f1d6-dc75-4bdd-a06c-0758cbaa07c1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:42.369073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:42.370203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.370638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.371106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.383140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:42.384964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:42.404739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:42.405860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:42.406994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:42.406994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:42.406994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:42.406994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:42.408917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 422/869] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:42.414181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b359-81d6-49cd-9599-0fd685df3b77 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:42.504865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:42.529123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943b359-81d6-49cd-9599-0fd685df3b77 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:42.565942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e15f-a14a-4526-b98c-3ce38d14e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:42.566876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e15f-a14a-4526-b98c-3ce38d14e3fe None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.567159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e15f-a14a-4526-b98c-3ce38d14e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.567438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e15f-a14a-4526-b98c-3ce38d14e3fe None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.568274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e15f-a14a-4526-b98c-3ce38d14e3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:42.568513 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e15f-a14a-4526-b98c-3ce38d14e3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:42.569901 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e15f-a14a-4526-b98c-3ce38d14e3fe None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:42.582735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 448/870] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:42.587979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:42.630640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520b52-b848-4463-befe-834cac5a5810 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.630950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520b52-b848-4463-befe-834cac5a5810 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.631132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab520b52-b848-4463-befe-834cac5a5810 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.632998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 449/871] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:42.642389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7106-e003-4bc9-8fbd-e569bfde5ae6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.642681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7106-e003-4bc9-8fbd-e569bfde5ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.642965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7106-e003-4bc9-8fbd-e569bfde5ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.653142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:42.665379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bd7c7106-e003-4bc9-8fbd-e569bfde5ae6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:42.666833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bd7c7106-e003-4bc9-8fbd-e569bfde5ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:42.695535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df8ac-812f-4ff0-8067-3018084ebda2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:42.731097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:42.731993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.732311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.732593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.740049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:42.748128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:42.748478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 450/872] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:42.755867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:42.756767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:42.757909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 423/873] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:42.763615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c7106-e003-4bc9-8fbd-e569bfde5ae6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:42.769105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:42.843428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:42.879155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c7106-e003-4bc9-8fbd-e569bfde5ae6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:42.880744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759e4e7-6ffe-4e7a-8f98-9cacb2e0d4ef None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:42.905883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:42.916071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c740fb-929f-468c-93a3-20f9e862b942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:42.916926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c740fb-929f-468c-93a3-20f9e862b942 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.917176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c740fb-929f-468c-93a3-20f9e862b942 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.917456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c740fb-929f-468c-93a3-20f9e862b942 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.918252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c740fb-929f-468c-93a3-20f9e862b942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:42.918568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c740fb-929f-468c-93a3-20f9e862b942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:42.919504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe1580-02c4-4002-8157-df7786968084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:42.920041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c740fb-929f-468c-93a3-20f9e862b942 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:42.920226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1580-02c4-4002-8157-df7786968084 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.920477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1580-02c4-4002-8157-df7786968084 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.920744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe1580-02c4-4002-8157-df7786968084 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.921470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe1580-02c4-4002-8157-df7786968084 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:42.922836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe1580-02c4-4002-8157-df7786968084 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:42.933144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 451/874] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:42.935314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3644bb2-340f-4688-b05d-11145a40b3a0 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.935790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3644bb2-340f-4688-b05d-11145a40b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.936273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3644bb2-340f-4688-b05d-11145a40b3a0 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.937980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 452/875] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:42.939514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3644bb2-340f-4688-b05d-11145a40b3a0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:42.945732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 424/876] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:04:42 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:04:42.946908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5976-1430-4b02-937f-c639ffba3660 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:42.947195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5976-1430-4b02-937f-c639ffba3660 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:42.947467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e5976-1430-4b02-937f-c639ffba3660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:42.970166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b61e5976-1430-4b02-937f-c639ffba3660 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:42.971514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b61e5976-1430-4b02-937f-c639ffba3660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:43.067543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 425/877] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:43.087494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5976-1430-4b02-937f-c639ffba3660 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:43.088687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3644bb2-340f-4688-b05d-11145a40b3a0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:43.135161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:43.144309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:43.145446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:43.145945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:43.147118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:43.148294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=e3152e449d7546ed92690a7b58ae027c) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:43.148903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:43.150481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:43.157268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 453/878] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:42 2022] GET /identity/v3/role_assignments?user.id=e3152e449d7546ed92690a7b58ae027c&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:43.226398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e5976-1430-4b02-937f-c639ffba3660 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:43.237883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:43.267105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:43.267930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:43.268246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:43.268525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:43.269194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:43.270600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:43.288631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:43.289708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:43.290610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 426/879] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:43.298985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:43.412841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799c95-21c4-4acb-af8b-c2a16dec9323 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:43.450687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7b436-247e-40de-bed5-4230c639ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:43.451366 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b436-247e-40de-bed5-4230c639ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:43.451652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b436-247e-40de-bed5-4230c639ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:43.451933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7b436-247e-40de-bed5-4230c639ceb0 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:43.452688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7b436-247e-40de-bed5-4230c639ceb0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:43.452994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7b436-247e-40de-bed5-4230c639ceb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:43.454402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7b436-247e-40de-bed5-4230c639ceb0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:43.460551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 454/880] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:43.467364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:43.577357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5043d-f968-47fe-89bf-cc84ac15648d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:43.616870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cb34d-760b-4598-a161-913cfd0d3e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:43.617553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb34d-760b-4598-a161-913cfd0d3e54 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:43.617838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb34d-760b-4598-a161-913cfd0d3e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:43.618115 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cb34d-760b-4598-a161-913cfd0d3e54 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:43.618827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cb34d-760b-4598-a161-913cfd0d3e54 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:43.619137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cb34d-760b-4598-a161-913cfd0d3e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:43.620545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cb34d-760b-4598-a161-913cfd0d3e54 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:43.625645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 427/881] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:44.419624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731acd34-ed40-4733-90f4-0aaa50cc0b5e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:44.420169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731acd34-ed40-4733-90f4-0aaa50cc0b5e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:44.420283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731acd34-ed40-4733-90f4-0aaa50cc0b5e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:44.421832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 455/882] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:44.427252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c59499-af32-436a-a6ca-89bd0dea10a7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:44.427661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c59499-af32-436a-a6ca-89bd0dea10a7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:44.427825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c59499-af32-436a-a6ca-89bd0dea10a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:44.445892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e1c59499-af32-436a-a6ca-89bd0dea10a7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:44.447099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e1c59499-af32-436a-a6ca-89bd0dea10a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:44.476176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:44.520703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 428/883] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:44.543123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731acd34-ed40-4733-90f4-0aaa50cc0b5e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:44.607530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:44.651128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731acd34-ed40-4733-90f4-0aaa50cc0b5e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:44.685874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:44.686599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:44.686889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:44.687164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:44.687826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:44.689246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:44.701736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:44.702945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:44.704004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 456/884] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:44.709248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c59499-af32-436a-a6ca-89bd0dea10a7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:44.818105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c59499-af32-436a-a6ca-89bd0dea10a7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:44.853262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:44.853942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:44.854229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:44.854508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:44.855218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:44.855524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:44.857506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:44.863074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 429/885] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:44.868449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:44.972165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b2e93-d93e-42b8-b20d-f484c26ab17e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:44.995945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:45.008183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:45.008865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.009153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.009433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.010149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:45.010456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:45.011843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:45.017279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 457/886] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:45.023027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:45.058024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:45.134814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53717455-389f-4db2-9b87-b2c4c033087b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:45.172284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e645d8-f236-4672-8b11-5eed93a25862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:45.172948 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e645d8-f236-4672-8b11-5eed93a25862 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.173234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e645d8-f236-4672-8b11-5eed93a25862 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.173513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e645d8-f236-4672-8b11-5eed93a25862 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.174311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e645d8-f236-4672-8b11-5eed93a25862 None admin] RBAC: Adding query filter params (interface=public, service_id=e3c720cebcfa4ded9ad9f95d1341f6b8, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:45.174687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e645d8-f236-4672-8b11-5eed93a25862 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:45.176141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e645d8-f236-4672-8b11-5eed93a25862 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:45.181970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 430/887] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Jul 14 11:04:45 2022] GET /identity/v3/endpoints?service_id=e3c720cebcfa4ded9ad9f95d1341f6b8&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:45.188368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:45.200235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6923e7-3c1b-4027-9d0c-3562ffa7c09a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.200571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6923e7-3c1b-4027-9d0c-3562ffa7c09a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.200802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6923e7-3c1b-4027-9d0c-3562ffa7c09a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.202423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 431/888] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:04:45.207657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97d3f-6168-4d85-acc2-2761b5d1d414 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.207959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97d3f-6168-4d85-acc2-2761b5d1d414 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.208263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa97d3f-6168-4d85-acc2-2761b5d1d414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.225611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8fa97d3f-6168-4d85-acc2-2761b5d1d414 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:45.226730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8fa97d3f-6168-4d85-acc2-2761b5d1d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:45.298572 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 432/889] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:45.306126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee73c12-463c-427a-87fc-7419ac24a575 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:45.321092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa97d3f-6168-4d85-acc2-2761b5d1d414 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:45.341714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821686a-95af-4e6f-8d9d-eb8e7f4af998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:45.342171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821686a-95af-4e6f-8d9d-eb8e7f4af998 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.342454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821686a-95af-4e6f-8d9d-eb8e7f4af998 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.342727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821686a-95af-4e6f-8d9d-eb8e7f4af998 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.343416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821686a-95af-4e6f-8d9d-eb8e7f4af998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:45.344818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821686a-95af-4e6f-8d9d-eb8e7f4af998 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:45.349784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:45.351205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 458/890] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:04:45 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:04:45.386393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e802e-9ee5-4206-ac73-66a754c22d69 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.386714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e802e-9ee5-4206-ac73-66a754c22d69 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.386958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e802e-9ee5-4206-ac73-66a754c22d69 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.389193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 459/891] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:45.394887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828097d-7ce2-402c-83d3-f8219451753c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.395198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828097d-7ce2-402c-83d3-f8219451753c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.395451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828097d-7ce2-402c-83d3-f8219451753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.413153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f828097d-7ce2-402c-83d3-f8219451753c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:45.414364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f828097d-7ce2-402c-83d3-f8219451753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:45.451275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa97d3f-6168-4d85-acc2-2761b5d1d414 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:45.469678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:45.494675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 460/892] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:45.506610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:45.507909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.508409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.508916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.510038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:45.511646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:45.518795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828097d-7ce2-402c-83d3-f8219451753c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:45.538052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:45.539069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:45.539994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:45.544523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 433/893] 10.222.0.17 () {56 vars in 1132 bytes} [Thu Jul 14 11:04:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:45.546077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:45.646765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828097d-7ce2-402c-83d3-f8219451753c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:45.663949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:45.681402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08963fc0-fd00-4111-ae36-848a6e01ead9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:45.687099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09991f68-d100-4d2e-92d6-c9852e7c9daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:45.688130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09991f68-d100-4d2e-92d6-c9852e7c9daf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.688586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09991f68-d100-4d2e-92d6-c9852e7c9daf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.689020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09991f68-d100-4d2e-92d6-c9852e7c9daf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.702604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09991f68-d100-4d2e-92d6-c9852e7c9daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-09991f68-d100-4d2e-92d6-c9852e7c9daf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:45.712563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:45.713541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:45.714376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 461/894] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Jul 14 11:04:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:45.720550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09991f68-d100-4d2e-92d6-c9852e7c9daf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:45.727849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:45.728866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.729374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.729876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.731386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:45.731907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:45.734423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:45.741608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 434/895] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:45.748885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:45.773838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:45.842703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09991f68-d100-4d2e-92d6-c9852e7c9daf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:45.868445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d9556-e990-4aa9-906e-558a77309de1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:45.878375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18cb12-eba4-4d5a-90ff-c2d29333e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:45.879330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cb12-eba4-4d5a-90ff-c2d29333e85c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.879803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cb12-eba4-4d5a-90ff-c2d29333e85c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.880304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18cb12-eba4-4d5a-90ff-c2d29333e85c None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.881137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18cb12-eba4-4d5a-90ff-c2d29333e85c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:45.881441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18cb12-eba4-4d5a-90ff-c2d29333e85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:45.882818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18cb12-eba4-4d5a-90ff-c2d29333e85c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:45.891682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 462/896] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Jul 14 11:04:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:45.892907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632cad-3511-44a8-b17f-b9bab2bbf341 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.893194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632cad-3511-44a8-b17f-b9bab2bbf341 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.893470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00632cad-3511-44a8-b17f-b9bab2bbf341 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.896570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 463/897] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:45.897848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00632cad-3511-44a8-b17f-b9bab2bbf341 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:45.912063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e31ad-ac6a-43d7-9a95-d169e2b8ad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:45.912774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e31ad-ac6a-43d7-9a95-d169e2b8ad32 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.913058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e31ad-ac6a-43d7-9a95-d169e2b8ad32 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.913334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e31ad-ac6a-43d7-9a95-d169e2b8ad32 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.914054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e31ad-ac6a-43d7-9a95-d169e2b8ad32 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:45.914359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e31ad-ac6a-43d7-9a95-d169e2b8ad32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:45.915734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e31ad-ac6a-43d7-9a95-d169e2b8ad32 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:45.921019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 435/898] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:45.926822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585b34d-5d21-43a6-be1b-f1ccea4365de None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:45.927059 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585b34d-5d21-43a6-be1b-f1ccea4365de None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:45.927330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585b34d-5d21-43a6-be1b-f1ccea4365de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:45.944638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d585b34d-5d21-43a6-be1b-f1ccea4365de None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:45.946812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d585b34d-5d21-43a6-be1b-f1ccea4365de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:45.961454 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.011786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00632cad-3511-44a8-b17f-b9bab2bbf341 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:46.015652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.028528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 436/899] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:46.028528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585b34d-5d21-43a6-be1b-f1ccea4365de None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:46.054940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:46.055744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:46.056029 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:46.056355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:46.068627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:46.070889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:46.090867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:46.091872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:46.092858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:46.092858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:46.092858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:46.092858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:46.092858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 464/900] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:46.097246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:46.140315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585b34d-5d21-43a6-be1b-f1ccea4365de None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:46.175365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:46.176037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:46.176364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:46.176643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:46.177475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] RBAC: Adding query filter params (interface=public, service_id=c733fd7e9140437cbf1895f90348fcee, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:46.177795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:46.179178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:46.190210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 437/901] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Jul 14 11:04:46 2022] GET /identity/v3/endpoints?service_id=c733fd7e9140437cbf1895f90348fcee&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:46.190210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:46.199293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.217831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8395b94-6918-4543-ade9-83f3fcf37671 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:46.254265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9af7a3-6690-4e38-8d7c-2c8667519106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:46.254926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af7a3-6690-4e38-8d7c-2c8667519106 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:46.255208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af7a3-6690-4e38-8d7c-2c8667519106 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:46.255481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9af7a3-6690-4e38-8d7c-2c8667519106 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:46.256224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9af7a3-6690-4e38-8d7c-2c8667519106 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:46.257594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9af7a3-6690-4e38-8d7c-2c8667519106 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:46.276241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 465/902] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:04:46 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:46.276241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9af7a3-6690-4e38-8d7c-2c8667519106 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:46.301491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb0ce-8852-405f-bfd7-f739d73a15ab None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:46.315460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.350816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:46.351499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:46.351780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:46.352166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:46.352829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:46.353137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:46.354543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:46.373999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 438/903] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:46.377000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:46.442695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9af7a3-6690-4e38-8d7c-2c8667519106 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:46.457470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.488853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d52d17-e657-47ef-af6f-a8fd6713d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:46.489695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d52d17-e657-47ef-af6f-a8fd6713d37b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:46.489988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d52d17-e657-47ef-af6f-a8fd6713d37b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:46.490530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d52d17-e657-47ef-af6f-a8fd6713d37b None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:46.490967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d52d17-e657-47ef-af6f-a8fd6713d37b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:46.492702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d52d17-e657-47ef-af6f-a8fd6713d37b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:46.500692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 466/904] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:04:46 2022] GET /identity/v3/services => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:04:46.510517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4413432-4823-41de-8696-9af9c7043306 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:46.551304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:46.552292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:46.552646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:46.552991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:46.563256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:46.565107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:46.582552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:46.583611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:46.584609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 439/905] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:04:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:46.591927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d52d17-e657-47ef-af6f-a8fd6713d37b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:46.681644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.703711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d52d17-e657-47ef-af6f-a8fd6713d37b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:46.739210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:46.739879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:46.740188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:46.740473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:46.741314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:46.741620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:46.743046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:46.762236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 467/906] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Jul 14 11:04:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:46.768430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:46.873093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302073-d42d-4ce1-a73f-bdc1fe42aeee None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:46.899326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:46.909181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53777f9-4248-45d4-9d42-b4dca08bbbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:46.909842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53777f9-4248-45d4-9d42-b4dca08bbbff None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:46.910129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53777f9-4248-45d4-9d42-b4dca08bbbff None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:46.910407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53777f9-4248-45d4-9d42-b4dca08bbbff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:46.984650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53777f9-4248-45d4-9d42-b4dca08bbbff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:46.986313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53777f9-4248-45d4-9d42-b4dca08bbbff None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:47.094129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 440/907] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:46 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:04:47.101202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:47.219829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432d2b7-23b8-45a1-9883-eddbf5fed876 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:47.255774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:47.256970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.257452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.257943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.264986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:47.269911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:47.271883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:47.294624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:47.295748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:47.296744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:47.296744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:47.296744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:47.296744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:47.299044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 468/908] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:47.304792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53777f9-4248-45d4-9d42-b4dca08bbbff None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:47.332387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:47.410365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53777f9-4248-45d4-9d42-b4dca08bbbff None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:47.456845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb4e91-8770-41f4-a35d-334de4271490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:47.457528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4e91-8770-41f4-a35d-334de4271490 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.458064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4e91-8770-41f4-a35d-334de4271490 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.458064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb4e91-8770-41f4-a35d-334de4271490 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.458798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb4e91-8770-41f4-a35d-334de4271490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:47.459106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb4e91-8770-41f4-a35d-334de4271490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:47.460539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb4e91-8770-41f4-a35d-334de4271490 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:47.473738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 441/909] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:47.479316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:47.512355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d734-3114-40a2-bb67-c09d7014edfa None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.512729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d734-3114-40a2-bb67-c09d7014edfa None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.512970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2d734-3114-40a2-bb67-c09d7014edfa None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.514845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 442/910] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:47.523075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a7a8f-0cab-466d-92c1-1990c8ca5323 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.523384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a7a8f-0cab-466d-92c1-1990c8ca5323 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.525462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a7a8f-0cab-466d-92c1-1990c8ca5323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.546883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b11a7a8f-0cab-466d-92c1-1990c8ca5323 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:47.548920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b11a7a8f-0cab-466d-92c1-1990c8ca5323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:47.595899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533752be-86b1-4e13-a61a-2a47f5f2194d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:47.632100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:47.632984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.633264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.633537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.636915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 443/911] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:47.648135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:47.648135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:47.659861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a7a8f-0cab-466d-92c1-1990c8ca5323 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:47.661894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:47.662815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:47.664494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 469/912] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:47.669140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:47.677884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:47.722647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:47.761610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a7a8f-0cab-466d-92c1-1990c8ca5323 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:47.776785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50add8f-4a9d-4897-b790-97cdf4273e70 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:47.797761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:47.798758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.799155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.799531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.800403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:47.801921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:47.814660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:47.815833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 11:04:47.816984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:47.817734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 444/913] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:47.828142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:47.828334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:47.828428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.828428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.828428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.828428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:47.828428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:47.828428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:47.842967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 470/914] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:47.849552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:47.918561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:47.940451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556a5f-adb9-471b-ba2d-cbe6b587aaf2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:47.958985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ab641-1831-4856-83c9-79658634b88f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:47.978193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:47.979158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.979626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.980128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.981048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:47.981568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:47.983133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:47.984482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:47.993607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 445/915] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:47.995223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:47.996947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:47.997619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:47.997905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:47.998184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:47.999043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] RBAC: Adding query filter params (role.id=020fbe9bfbb84fec9464ee144ef0181f, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=e3152e449d7546ed92690a7b58ae027c) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:47.999367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:48.001166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:48.012331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 471/916] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:47 2022] GET /identity/v3/role_assignments?user.id=e3152e449d7546ed92690a7b58ae027c&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=020fbe9bfbb84fec9464ee144ef0181f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:48.115801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bf18f-6083-4069-a23d-96e5ba394b2e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:48.155560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414c951-f7fb-4aea-b1d3-b82e55303a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:48.156788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c951-f7fb-4aea-b1d3-b82e55303a3c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:48.157283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c951-f7fb-4aea-b1d3-b82e55303a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:48.157824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c951-f7fb-4aea-b1d3-b82e55303a3c None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:48.158753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414c951-f7fb-4aea-b1d3-b82e55303a3c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:48.159278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414c951-f7fb-4aea-b1d3-b82e55303a3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:48.160894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414c951-f7fb-4aea-b1d3-b82e55303a3c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:48.171659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 446/917] 10.222.0.17 () {56 vars in 1114 bytes} [Thu Jul 14 11:04:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:48.173293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:48.283828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5855cf-b036-4664-a361-a31d4656c205 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:48.319524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aaa87-165b-43ac-aedf-ecc05d8b899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:48.320588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaa87-165b-43ac-aedf-ecc05d8b899e None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:48.321121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaa87-165b-43ac-aedf-ecc05d8b899e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:48.321602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aaa87-165b-43ac-aedf-ecc05d8b899e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:48.322571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aaa87-165b-43ac-aedf-ecc05d8b899e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:48.324247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3aaa87-165b-43ac-aedf-ecc05d8b899e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:48.352283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 472/918] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:04:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:48.438319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2dee2-5aeb-44e2-b67d-5af87b094817 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:48.438673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2dee2-5aeb-44e2-b67d-5af87b094817 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:48.438893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2dee2-5aeb-44e2-b67d-5af87b094817 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:48.440622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 447/919] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:48.446385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b69b85-2f2f-42b0-a457-5947ef3e17f0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:48.446686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b69b85-2f2f-42b0-a457-5947ef3e17f0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:48.446968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b69b85-2f2f-42b0-a457-5947ef3e17f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:48.465242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c1b69b85-2f2f-42b0-a457-5947ef3e17f0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:48.466520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c1b69b85-2f2f-42b0-a457-5947ef3e17f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:48.494940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:48.549714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 473/920] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:48.573646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2dee2-5aeb-44e2-b67d-5af87b094817 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:48.586112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:48.686844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2dee2-5aeb-44e2-b67d-5af87b094817 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:48.721717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a63ec-c8bb-43da-b834-6feaef5e45e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:48.722575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a63ec-c8bb-43da-b834-6feaef5e45e5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:48.722854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a63ec-c8bb-43da-b834-6feaef5e45e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:48.723125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a63ec-c8bb-43da-b834-6feaef5e45e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:48.723777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a63ec-c8bb-43da-b834-6feaef5e45e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:48.725221 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a63ec-c8bb-43da-b834-6feaef5e45e5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-727a63ec-c8bb-43da-b834-6feaef5e45e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:48.738207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:48.739235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:48.740516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 448/921] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:48.745882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b69b85-2f2f-42b0-a457-5947ef3e17f0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:48.770855 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d6888-0d57-43ec-a41c-d2576a2f7fd3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:48.771196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d6888-0d57-43ec-a41c-d2576a2f7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:48.771397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d6888-0d57-43ec-a41c-d2576a2f7fd3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:48.773362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 449/922] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:04:48.779973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607103-39bb-4139-88c4-4eb0682ca02d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:48.780518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607103-39bb-4139-88c4-4eb0682ca02d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:48.780907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607103-39bb-4139-88c4-4eb0682ca02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:48.800952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-52607103-39bb-4139-88c4-4eb0682ca02d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:48.802470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-52607103-39bb-4139-88c4-4eb0682ca02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:48.868722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b69b85-2f2f-42b0-a457-5947ef3e17f0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:48.904206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 450/923] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:48.912293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:48.912971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:48.913258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:48.913537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:48.914261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:48.914570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:48.915954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:48.922316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 474/924] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:48.927815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52607103-39bb-4139-88c4-4eb0682ca02d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:48.929163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:48.930269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:48.965283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:49.049218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52607103-39bb-4139-88c4-4eb0682ca02d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:49.058591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c762d-1f75-415f-87a2-dfc74c603426 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:49.091217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:49.092412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:49.092906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:49.093404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:49.094293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:49.095665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:49.096147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:49.096391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:49.096677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:49.096952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:49.097667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:49.097974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:49.099381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:49.110268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 475/925] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:49.111181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:49.112299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:49.113227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 11:04:49.114084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:49.121636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 451/926] 10.222.0.17 () {56 vars in 1132 bytes} [Thu Jul 14 11:04:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:49.123360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:49.197380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:49.210575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:49.229578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917701b7-1a96-4054-acd1-fefacec95df5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:49.238025 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe1f69-5bc6-46ce-9e2e-4d14f4e55073 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:49.265530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:49.266238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:49.266527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:49.266805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:49.267619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] RBAC: Adding query filter params (interface=public, service_id=9569becfdd764ece8fa1b4d58b3ad036, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:49.267911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:49.269332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:49.276007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:49.276977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:49.277479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:49.277958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:49.279493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:49.280016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:49.281614 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:49.282558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 476/927] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Jul 14 11:04:49 2022] GET /identity/v3/endpoints?service_id=9569becfdd764ece8fa1b4d58b3ad036&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:49.283436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:49.292455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 452/928] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:49.294027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:49.392910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc13ca-a150-4645-b0ee-40ab68f2c747 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:49.399455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b495fdf-c35c-43ed-87ed-9428aa0472d0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:49.428195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aca5dd-b64c-477a-b0c1-d518ab85f1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:49.428860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aca5dd-b64c-477a-b0c1-d518ab85f1ad None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:49.429143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aca5dd-b64c-477a-b0c1-d518ab85f1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:49.429421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aca5dd-b64c-477a-b0c1-d518ab85f1ad None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:49.430111 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aca5dd-b64c-477a-b0c1-d518ab85f1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:49.430950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:49.431705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aca5dd-b64c-477a-b0c1-d518ab85f1ad None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:49.438284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67edee-6102-450f-9235-875ae7035d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:49.438822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 477/929] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:04:49 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:04:49.439807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67edee-6102-450f-9235-875ae7035d36 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:49.440343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67edee-6102-450f-9235-875ae7035d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:49.440825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67edee-6102-450f-9235-875ae7035d36 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:49.442015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67edee-6102-450f-9235-875ae7035d36 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:49.442549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67edee-6102-450f-9235-875ae7035d36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:49.444208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67edee-6102-450f-9235-875ae7035d36 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:49.455879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 453/930] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:49.457760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aca5dd-b64c-477a-b0c1-d518ab85f1ad None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:49.492363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:49.580477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aca5dd-b64c-477a-b0c1-d518ab85f1ad None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:49.621821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328985a-6cc5-4267-aae8-e9b3140599ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:49.623026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328985a-6cc5-4267-aae8-e9b3140599ed None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:49.623305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328985a-6cc5-4267-aae8-e9b3140599ed None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:49.623586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328985a-6cc5-4267-aae8-e9b3140599ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:49.624380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328985a-6cc5-4267-aae8-e9b3140599ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:49.625964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328985a-6cc5-4267-aae8-e9b3140599ed None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:49.647868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 478/931] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:04:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:04:50.121843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d937fc-b625-497b-a221-8e7604f50c24 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.122960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d937fc-b625-497b-a221-8e7604f50c24 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.123056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d937fc-b625-497b-a221-8e7604f50c24 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.124670 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 454/932] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:50.130088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad854a-9bdc-413f-8429-4b0de8cf20df None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.130494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad854a-9bdc-413f-8429-4b0de8cf20df None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.130663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad854a-9bdc-413f-8429-4b0de8cf20df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.148198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bdad854a-9bdc-413f-8429-4b0de8cf20df None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:50.149396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bdad854a-9bdc-413f-8429-4b0de8cf20df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:50.217004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:50.232614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 479/933] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:50.254696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d937fc-b625-497b-a221-8e7604f50c24 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:50.361905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d937fc-b625-497b-a221-8e7604f50c24 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:50.398341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f33a-73fa-4cfc-8f3b-9e8bf4273e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:50.399485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f33a-73fa-4cfc-8f3b-9e8bf4273e64 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.399988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f33a-73fa-4cfc-8f3b-9e8bf4273e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.400513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f33a-73fa-4cfc-8f3b-9e8bf4273e64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.412805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1f33a-73fa-4cfc-8f3b-9e8bf4273e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-70f1f33a-73fa-4cfc-8f3b-9e8bf4273e64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:50.421856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:50.422786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:04:50.423651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:50.426424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 455/934] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Jul 14 11:04:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:50.436127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad854a-9bdc-413f-8429-4b0de8cf20df None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:50.538240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad854a-9bdc-413f-8429-4b0de8cf20df None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:50.564436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65965a-b2d2-4c0b-9491-d8e949c1dc76 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.565343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65965a-b2d2-4c0b-9491-d8e949c1dc76 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.566105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65965a-b2d2-4c0b-9491-d8e949c1dc76 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.568647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 456/935] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:50.573124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4aed1-ea96-4770-8ae4-0ab8e66dab70 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.573671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4aed1-ea96-4770-8ae4-0ab8e66dab70 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.574210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4aed1-ea96-4770-8ae4-0ab8e66dab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.579509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:50.580203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.580490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.580763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.581509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:50.581811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:50.583234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:50.592325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 480/936] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Jul 14 11:04:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:50.594420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0bc4aed1-ea96-4770-8ae4-0ab8e66dab70 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:50.596094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0bc4aed1-ea96-4770-8ae4-0ab8e66dab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:50.597731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:50.657029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:50.665254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:50.678872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 457/937] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:50.708369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4aed1-ea96-4770-8ae4-0ab8e66dab70 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:50.720817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d1fb-92df-457e-a996-2e404121d5d4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:50.764056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:50.764908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.765189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.765465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.779952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:50.781597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:50.803274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:50.804261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:50.805163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:50.805163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:50.805163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:50.805163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:50.809449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 481/938] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:50.810449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:50.829573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4aed1-ea96-4770-8ae4-0ab8e66dab70 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:50.869516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:50.870585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.871090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.871616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.872827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:50.874608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:50.876319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING keystone.server.flask.common [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 11:04:50.896956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.sql.core [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:04:50.896956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 11:04:50.896956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [parameters: {'id': '9a661f7b4e594b0b9aa30ec28969160f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 11:04:50.896956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80333) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a661f7b4e594b0b9aa30ec28969160f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a661f7b4e594b0b9aa30ec28969160f. Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:04:50.908401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 11:04:50.909238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application yield resource Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise self.value Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application session.commit() Jul 14 11:04:50.910229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.session.flush() Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application compat.raise_( Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 11:04:50.911168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 11:04:50.912079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application result.read() Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:04:50.914050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [parameters: {'id': '9a661f7b4e594b0b9aa30ec28969160f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:50.916796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:50.917607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9a661f7b4e594b0b9aa30ec28969160f. Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:50.918536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 458/939] 10.222.0.17 () {60 vars in 1140 bytes} [Thu Jul 14 11:04:50 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:50.920684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:50.938869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15aa87-1f64-4b95-a581-a6d19ef26640 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:50.948414 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:50.975522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:50.977205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:50.977923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:50.978203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:50.978490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:50.979210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:50.979564 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:50.981032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:50.998625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 482/940] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:50.999536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:51.050324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be742c2-99a7-4620-b017-44735f977d52 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:51.088237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:51.089403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.089909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.090388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.097705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:51.099892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:51.105630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b937-14d5-41dc-8b20-d222d4db0f11 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:51.115130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:51.116057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:51.116987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:51.116987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:51.116987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:51.116987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:51.116987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:51.116987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:51.116987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:51.116987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:51.124669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 459/941] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:51.126214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:51.141887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:51.142706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.142986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.143259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.150704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:51.152296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:51.167955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:51.168982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:51.169959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 483/942] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:04:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:51.174939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:51.214104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:51.241054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:51.245112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08c90-e337-4b91-b345-d39c385d9923 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:51.282302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:51.283350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.283859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.284369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.285351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:51.285870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:51.287497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:51.292690 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232171f3-472a-4861-8b73-d3e380f8eed2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:51.316428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 460/943] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:51.332726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:51.333446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.333726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.333998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.334862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:51.335170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:51.336705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:51.357524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 484/944] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Jul 14 11:04:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:51.363276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:51.478239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097794-f38b-464b-9ff9-29fca3ab5aee None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:51.516202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7984f6-1bbb-44f8-a0bb-8fee86884636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:51.517412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7984f6-1bbb-44f8-a0bb-8fee86884636 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.517898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7984f6-1bbb-44f8-a0bb-8fee86884636 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.518430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7984f6-1bbb-44f8-a0bb-8fee86884636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.529658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7984f6-1bbb-44f8-a0bb-8fee86884636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:51.532142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7984f6-1bbb-44f8-a0bb-8fee86884636 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0d7984f6-1bbb-44f8-a0bb-8fee86884636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:51.551527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:51.552558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:51.553474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:51.553474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:51.553474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:51.553474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:51.554142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 461/945] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:51.560089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:51.655124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2766-6c9f-422a-8134-4f562f2228bf None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.655786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2766-6c9f-422a-8134-4f562f2228bf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.656412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d2766-6c9f-422a-8134-4f562f2228bf None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.657061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:51.659033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 462/946] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:51.664898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01140cf-75f9-45e6-89a0-e7b35099547f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.665188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01140cf-75f9-45e6-89a0-e7b35099547f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.665496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01140cf-75f9-45e6-89a0-e7b35099547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.677749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224f5c4-44f3-4d30-8091-ed8914063e35 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:51.686636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d01140cf-75f9-45e6-89a0-e7b35099547f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:51.689508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d01140cf-75f9-45e6-89a0-e7b35099547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:51.700134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:51.717955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:51.718630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.718910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.719185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.719926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:51.720253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:51.721649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:51.735478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 485/947] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:51.741155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:51.775721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 463/948] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:51.799573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01140cf-75f9-45e6-89a0-e7b35099547f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:51.855444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539854e3-9005-4ce1-9cc4-ccce1ca9ca92 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:51.889939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f89dd1-3172-4d68-82c2-b9e9bb2ed779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:51.890746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89dd1-3172-4d68-82c2-b9e9bb2ed779 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.891031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89dd1-3172-4d68-82c2-b9e9bb2ed779 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.891307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f89dd1-3172-4d68-82c2-b9e9bb2ed779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.900276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f89dd1-3172-4d68-82c2-b9e9bb2ed779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:51.901739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f89dd1-3172-4d68-82c2-b9e9bb2ed779 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f1f89dd1-3172-4d68-82c2-b9e9bb2ed779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:51.916655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:51.917573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:51.918492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:51.918492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:51.918492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:51.918492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:51.918492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:51.918492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:51.918492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:51.918492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:51.919502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01140cf-75f9-45e6-89a0-e7b35099547f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:51.923036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 486/949] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:51.924581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebffdce-54e8-4dd8-a496-9816505adae2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.924777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebffdce-54e8-4dd8-a496-9816505adae2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.925067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebffdce-54e8-4dd8-a496-9816505adae2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.926524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 487/950] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:51.927266 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebffdce-54e8-4dd8-a496-9816505adae2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:51.937409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:51.961334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bb8a7-997c-4497-b03e-2b98ac8d664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:51.962242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bb8a7-997c-4497-b03e-2b98ac8d664b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.962602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bb8a7-997c-4497-b03e-2b98ac8d664b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.962885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bb8a7-997c-4497-b03e-2b98ac8d664b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.963544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bb8a7-997c-4497-b03e-2b98ac8d664b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:51.965090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bb8a7-997c-4497-b03e-2b98ac8d664b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1e3bb8a7-997c-4497-b03e-2b98ac8d664b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:51.978896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:51.979926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:51.980826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 464/951] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:51.983215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba52bd8-54da-446c-90b9-438fce6eabc3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:51.983215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba52bd8-54da-446c-90b9-438fce6eabc3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:51.983215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba52bd8-54da-446c-90b9-438fce6eabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:51.995841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:52.001163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8ba52bd8-54da-446c-90b9-438fce6eabc3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:52.002370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8ba52bd8-54da-446c-90b9-438fce6eabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:52.051161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebffdce-54e8-4dd8-a496-9816505adae2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:52.084187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 465/952] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:52.084187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba52bd8-54da-446c-90b9-438fce6eabc3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:52.098507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:52.099254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:52.099688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:52.100024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:52.100952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:52.101268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:52.102714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:52.120721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 488/953] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:52.120721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:52.191185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:52.204768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba52bd8-54da-446c-90b9-438fce6eabc3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:52.233307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4352f9-e114-4171-b9cd-4f0163daba67 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:52.242522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:52.243189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:52.243473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:52.243749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:52.244526 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:52.244811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:52.246246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:52.248090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:52.253403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 466/954] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:52.254256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:52.274643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:52.275697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:52.276163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:52.277084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:52.277902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:52.280312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:52.293116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:52.294503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:04:52.295611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:52.303150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 489/955] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:52.304229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:52.354834 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094e2d-7478-491c-b5f1-53eebe94b98a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:52.390229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda518-edee-431e-8bfa-aa8257d9372c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:52.391127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda518-edee-431e-8bfa-aa8257d9372c None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:52.391410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda518-edee-431e-8bfa-aa8257d9372c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:52.391694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dda518-edee-431e-8bfa-aa8257d9372c None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/e3152e449d7546ed92690a7b58ae027c/roles/020fbe9bfbb84fec9464ee144ef0181f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:52.394047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dda518-edee-431e-8bfa-aa8257d9372c None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=e3152e449d7546ed92690a7b58ae027c, role_id=020fbe9bfbb84fec9464ee144ef0181f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:52.395498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dda518-edee-431e-8bfa-aa8257d9372c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:52.410506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 467/956] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:04:52 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/e3152e449d7546ed92690a7b58ae027c/roles/020fbe9bfbb84fec9464ee144ef0181f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:04:52.411653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda518-edee-431e-8bfa-aa8257d9372c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:52.429902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cfbc-ac71-4b62-93a0-62c67303df9e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:52.462589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:52.469799 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:52.470976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:52.471753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:52.472290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:52.473373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:52.473759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:52.475319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:52.481773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 490/957] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:52.488834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:52.506514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:52.570985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dda518-edee-431e-8bfa-aa8257d9372c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:52.614307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:52.615453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:52.615735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:52.616007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:52.617094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:52.617094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:52.618415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:52.626124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 468/958] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:52.631655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:52.642399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf51b13-d627-4d3c-835f-64cb3c6c78df None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:52.683113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8388ed-1b05-46ef-9611-9be450c67178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:52.684257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8388ed-1b05-46ef-9611-9be450c67178 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:52.685298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8388ed-1b05-46ef-9611-9be450c67178 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:52.685802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8388ed-1b05-46ef-9611-9be450c67178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:52.686755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8388ed-1b05-46ef-9611-9be450c67178 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:52.688381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8388ed-1b05-46ef-9611-9be450c67178 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:52.712988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 491/959] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:04:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:52.760165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9d1d-b7f1-40c8-a048-f1df64b0c62b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:52.789293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:52.810147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07a3e7-5bdb-40f3-ac9b-7f36737dd52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:52.811255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07a3e7-5bdb-40f3-ac9b-7f36737dd52f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:52.811747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07a3e7-5bdb-40f3-ac9b-7f36737dd52f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:52.812279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07a3e7-5bdb-40f3-ac9b-7f36737dd52f None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:52.813362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07a3e7-5bdb-40f3-ac9b-7f36737dd52f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:52.813871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07a3e7-5bdb-40f3-ac9b-7f36737dd52f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:52.815592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07a3e7-5bdb-40f3-ac9b-7f36737dd52f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:52.822065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 469/960] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:53.518943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdfde-c244-4045-b3a4-c8e04ccf8cc4 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:53.519957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdfde-c244-4045-b3a4-c8e04ccf8cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:53.520491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efffdfde-c244-4045-b3a4-c8e04ccf8cc4 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:53.522575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 492/961] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:53.530024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617d0f-71b7-4ce8-a048-190ff556eedb None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:53.530024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617d0f-71b7-4ce8-a048-190ff556eedb None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:53.530024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0617d0f-71b7-4ce8-a048-190ff556eedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:53.547002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e0617d0f-71b7-4ce8-a048-190ff556eedb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:53.548369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e0617d0f-71b7-4ce8-a048-190ff556eedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:53.618737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 470/962] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:53.643971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffdfde-c244-4045-b3a4-c8e04ccf8cc4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:53.696121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:53.751587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efffdfde-c244-4045-b3a4-c8e04ccf8cc4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:53.785533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:53.786415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:53.786861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:53.787282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:53.788146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:53.789719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:53.791169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING keystone.server.flask.common [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 11:04:53.805537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.sql.core [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:04:53.805537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 11:04:53.805537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [parameters: {'user_id': '6ead7131a2bb46c58e7b56a185a99b2b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 11:04:53.805537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80334) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application result.read() Jul 14 11:04:53.823705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:04:53.824855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application yield resource Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application next(self.gen) Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise self.value Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application session.commit() Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 11:04:53.826075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self.session.flush() Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application compat.raise_( Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 11:04:53.827090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 11:04:53.827984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application conn.query(q) Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application result.read() Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 11:04:53.828967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [parameters: {'user_id': '6ead7131a2bb46c58e7b56a185a99b2b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:53.829992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 11:04:53.830929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 11:04:53.831833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 11:04:53.831833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 11:04:53.831833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 11:04:53.831833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 11:04:53.831833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 11:04:53.831833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:53.834005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 493/963] 10.222.0.17 () {60 vars in 1131 bytes} [Thu Jul 14 11:04:53 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:53.840073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617d0f-71b7-4ce8-a048-190ff556eedb None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:53.946499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0617d0f-71b7-4ce8-a048-190ff556eedb None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:53.962145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:53.983287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac049b82-5a6e-4cd6-9339-b59b19cd54d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:53.984087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac049b82-5a6e-4cd6-9339-b59b19cd54d3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:53.984393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac049b82-5a6e-4cd6-9339-b59b19cd54d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:53.984663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac049b82-5a6e-4cd6-9339-b59b19cd54d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:53.992390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac049b82-5a6e-4cd6-9339-b59b19cd54d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:53.993840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac049b82-5a6e-4cd6-9339-b59b19cd54d3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ac049b82-5a6e-4cd6-9339-b59b19cd54d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:54.009137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:54.010137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:54.011095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 471/964] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:04:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:54.016965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:54.120383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843ca0e-f8ef-494e-9dc2-6419f5112ccb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:54.133847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:54.163117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57af79-1cd1-4cd0-b72e-84ec0d718734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:54.164015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57af79-1cd1-4cd0-b72e-84ec0d718734 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:54.164495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57af79-1cd1-4cd0-b72e-84ec0d718734 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:54.164916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57af79-1cd1-4cd0-b72e-84ec0d718734 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:54.165859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57af79-1cd1-4cd0-b72e-84ec0d718734 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:54.166309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57af79-1cd1-4cd0-b72e-84ec0d718734 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:54.168089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57af79-1cd1-4cd0-b72e-84ec0d718734 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:54.209877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 494/965] 10.222.0.17 () {56 vars in 1101 bytes} [Thu Jul 14 11:04:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:54.601536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9afd38-13b7-4934-b541-ffcc796b8b47 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:54.602049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9afd38-13b7-4934-b541-ffcc796b8b47 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:54.602049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9afd38-13b7-4934-b541-ffcc796b8b47 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:54.603593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 472/966] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:54.608671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28629947-e649-4359-b676-542b31a88ef2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:54.609052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28629947-e649-4359-b676-542b31a88ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:54.609225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28629947-e649-4359-b676-542b31a88ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:54.626039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-28629947-e649-4359-b676-542b31a88ef2 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:54.627539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-28629947-e649-4359-b676-542b31a88ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:54.697942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 495/967] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:54.722223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9afd38-13b7-4934-b541-ffcc796b8b47 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:54.826795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9afd38-13b7-4934-b541-ffcc796b8b47 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:54.861043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f5180-2109-423b-bfb3-89c45056bcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:54.861847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5180-2109-423b-bfb3-89c45056bcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:54.862129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5180-2109-423b-bfb3-89c45056bcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:54.862399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f5180-2109-423b-bfb3-89c45056bcb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:54.872949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f5180-2109-423b-bfb3-89c45056bcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-638f5180-2109-423b-bfb3-89c45056bcb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:04:54.881146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:54.882137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:04:54.882989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:54.887336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 473/968] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Jul 14 11:04:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:54.888806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046a704-30ff-4736-8c40-1d0388523662 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:54.889096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046a704-30ff-4736-8c40-1d0388523662 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:54.889244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148d52d-936a-499d-8f1d-73fb4de810f2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:54.889372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046a704-30ff-4736-8c40-1d0388523662 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:54.889528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148d52d-936a-499d-8f1d-73fb4de810f2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:54.889801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148d52d-936a-499d-8f1d-73fb4de810f2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:54.890733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 496/969] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:04:54.891217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 474/970] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:54.891409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046a704-30ff-4736-8c40-1d0388523662 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:54.895971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68ada-046d-4455-9a70-cee836ef69a5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:54.896298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68ada-046d-4455-9a70-cee836ef69a5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:54.896575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee68ada-046d-4455-9a70-cee836ef69a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:54.912636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dee68ada-046d-4455-9a70-cee836ef69a5 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:54.913831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dee68ada-046d-4455-9a70-cee836ef69a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:54.940529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:54.980790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 475/971] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:54.982078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a0dad-91ac-4ecc-8bee-572c1e96e60d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:54.982366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a0dad-91ac-4ecc-8bee-572c1e96e60d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:54.982645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a0dad-91ac-4ecc-8bee-572c1e96e60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:54.991486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:54.995937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046a704-30ff-4736-8c40-1d0388523662 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.000182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-132a0dad-91ac-4ecc-8bee-572c1e96e60d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:55.001382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-132a0dad-91ac-4ecc-8bee-572c1e96e60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:55.034803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.035470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.035750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.036030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.036820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:55.037122 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.038491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.046757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 497/972] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Jul 14 11:04:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:55.047530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.069048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 476/973] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:55.072719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a0dad-91ac-4ecc-8bee-572c1e96e60d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.146816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d46a-9677-477f-a871-dd309a34a994 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.163658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:55.171182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a0dad-91ac-4ecc-8bee-572c1e96e60d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.179397 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560fff3-2b85-4ed4-8b7c-9cc250e52c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.180062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560fff3-2b85-4ed4-8b7c-9cc250e52c13 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.180368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560fff3-2b85-4ed4-8b7c-9cc250e52c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.180641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560fff3-2b85-4ed4-8b7c-9cc250e52c13 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.181360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560fff3-2b85-4ed4-8b7c-9cc250e52c13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.182724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560fff3-2b85-4ed4-8b7c-9cc250e52c13 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.196731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 498/974] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:04:55 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:55.197523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560fff3-2b85-4ed4-8b7c-9cc250e52c13 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.213934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.214795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.215082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.215359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.227428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.228965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.236837 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:55.252691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:55.253894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:55.255469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:55.255469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:55.255469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:55.255469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:55.255469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 477/975] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:55.259912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.332247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560fff3-2b85-4ed4-8b7c-9cc250e52c13 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.371198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.372654 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.372944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.373528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.374511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.375586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.375843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac684ca-199b-4727-8a6d-cc1b07cb0785 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:55.389175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:55.390267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:55.391123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 499/976] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:55.397341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.421096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.421778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.422212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.422498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.423336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:55.423544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.424948 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.437658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 478/977] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:55.443339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.446206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:55.498711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:55.515134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ed885-81ee-45ca-82d6-7ab630666593 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.551185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.551855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.552157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.552437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.553160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:55.553465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.554841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.558251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82759b-a710-4894-991d-2d3fc0a0fcf8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.560385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 500/978] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:55.566236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.595134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.595946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.596258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.596654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.605671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.607801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:04:55.623131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:55.624508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 11:04:55.625808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:55.628988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 479/979] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:04:55.629796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.675293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394dbfd6-7026-41a0-952d-42353c244851 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.695263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:55.710317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.710989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.711275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.711549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.712292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:55.712601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.713968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.719354 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 501/980] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:55.725151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.741999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:55.743470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937310b8-6db3-4aad-83c1-f717b0ce9575 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.782031 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.782702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.782988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.783266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.784125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:55.784440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.785901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.808691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 480/981] 10.222.0.17 () {56 vars in 1149 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:55.809780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.835583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3a623-b9c2-4835-81cb-af4d2adee004 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.871985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.872733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.873016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.873293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.874090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] RBAC: Adding query filter params (interface=admin, service_id=9569becfdd764ece8fa1b4d58b3ad036, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:55.874400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:55.875895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:55.885954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 502/982] 10.222.0.17 () {56 vars in 1249 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/endpoints?service_id=9569becfdd764ece8fa1b4d58b3ad036&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:55.886950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:55.912657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb19bbe-3f4c-4df2-ba90-4ac931c4d0d1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:55.934410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:55.949172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbb892-f6e4-4a23-88f5-76d263bf9d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:55.949822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb892-f6e4-4a23-88f5-76d263bf9d3a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:55.950643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb892-f6e4-4a23-88f5-76d263bf9d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:55.950918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbb892-f6e4-4a23-88f5-76d263bf9d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:55.976929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:55.999857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4984944-1f46-40a5-803b-a68ef770d91f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:56.023764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbb892-f6e4-4a23-88f5-76d263bf9d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:56.025663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbb892-f6e4-4a23-88f5-76d263bf9d3a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:56.034161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026d38b-c00f-4d28-bd3f-64f2903a2415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:56.034826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d38b-c00f-4d28-bd3f-64f2903a2415 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:56.035108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d38b-c00f-4d28-bd3f-64f2903a2415 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:56.035394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026d38b-c00f-4d28-bd3f-64f2903a2415 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:56.036083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026d38b-c00f-4d28-bd3f-64f2903a2415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:56.037490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1026d38b-c00f-4d28-bd3f-64f2903a2415 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:56.043711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 503/983] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:04:56.145621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 481/984] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:04:55 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:04:56.151263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026d38b-c00f-4d28-bd3f-64f2903a2415 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:56.264533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1026d38b-c00f-4d28-bd3f-64f2903a2415 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:56.299682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:56.300817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:56.301102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:56.301381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:56.314662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:56.316156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:56.318321 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:04:56.335651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:56.336894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:56.337819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:04:56.337819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:04:56.337819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:04:56.337819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:56.340193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 504/985] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:56.343218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbb892-f6e4-4a23-88f5-76d263bf9d3a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:56.365026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:56.445355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbb892-f6e4-4a23-88f5-76d263bf9d3a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:56.479816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:56.480517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:56.480804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:56.481155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:56.482452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:56.482965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:56.484527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:56.498045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 482/986] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:56.504091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:56.617775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d630f-1971-4bd6-b748-ac47350438bc None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:56.653652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:56.654807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:56.655090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:56.655362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:56.662303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:56.663733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:04:56.680230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:56.681708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:04:56.682625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 505/987] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:56.689325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:56.786891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:56.818948 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f410bf-a9f7-46b9-8a1c-8b2d9824eb1a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:56.857720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83e6d4-bd3d-41e9-b1fa-c41a6e4b6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:56.858398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e6d4-bd3d-41e9-b1fa-c41a6e4b6765 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:56.858685 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e6d4-bd3d-41e9-b1fa-c41a6e4b6765 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:56.858966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e6d4-bd3d-41e9-b1fa-c41a6e4b6765 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:56.859767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83e6d4-bd3d-41e9-b1fa-c41a6e4b6765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:56.860081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83e6d4-bd3d-41e9-b1fa-c41a6e4b6765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:56.861554 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83e6d4-bd3d-41e9-b1fa-c41a6e4b6765 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:56.881754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 483/988] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:04:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:56.883254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:56.946751 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:57.001542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c00631-1a2a-45e3-8e8b-c20f78730099 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:57.041510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51422c22-dd7d-4bbc-be5a-5a10521c7d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:57.042082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422c22-dd7d-4bbc-be5a-5a10521c7d60 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:57.042379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422c22-dd7d-4bbc-be5a-5a10521c7d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:57.042641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51422c22-dd7d-4bbc-be5a-5a10521c7d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:57.043462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51422c22-dd7d-4bbc-be5a-5a10521c7d60 None admin] RBAC: Adding query filter params (role.id=020fbe9bfbb84fec9464ee144ef0181f, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=e3152e449d7546ed92690a7b58ae027c) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:57.044390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51422c22-dd7d-4bbc-be5a-5a10521c7d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:57.046924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51422c22-dd7d-4bbc-be5a-5a10521c7d60 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:57.053610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 506/989] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:04:56 2022] GET /identity/v3/role_assignments?user.id=e3152e449d7546ed92690a7b58ae027c&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=020fbe9bfbb84fec9464ee144ef0181f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:57.315170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cc2d-ddc4-4eab-8e89-e20c9c66c8d0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:57.315369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cc2d-ddc4-4eab-8e89-e20c9c66c8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:57.315643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9cc2d-ddc4-4eab-8e89-e20c9c66c8d0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:57.317480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 484/990] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:57.322800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96dbf-b1bc-4918-87f1-af18dd350fc6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:57.323156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96dbf-b1bc-4918-87f1-af18dd350fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:57.323517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b96dbf-b1bc-4918-87f1-af18dd350fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:57.341989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e4b96dbf-b1bc-4918-87f1-af18dd350fc6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:57.343197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e4b96dbf-b1bc-4918-87f1-af18dd350fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:57.418604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 507/991] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:57.437120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9cc2d-ddc4-4eab-8e89-e20c9c66c8d0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:57.549560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9cc2d-ddc4-4eab-8e89-e20c9c66c8d0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:57.585985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:57.586794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:57.587077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:57.587350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:57.588007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:57.589410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:57.601681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:57.602726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:04:57.603597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:57.608183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 485/992] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:04:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:57.609851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b96dbf-b1bc-4918-87f1-af18dd350fc6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:57.660442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:57.713285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b96dbf-b1bc-4918-87f1-af18dd350fc6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:57.748500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:57.749170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:57.749510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:57.749869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:57.750611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:57.750919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:57.752336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:57.761757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 508/993] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:57.763428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:57.768361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:57.869953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce61880-c3f8-48a9-b9e3-f4634497c29c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:57.903469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:57.904167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:57.904455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:57.904730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:57.905438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:57.905745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:57.907117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:57.917681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 486/994] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:04:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:04:57.919737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:58.019068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af3666-ac45-4587-b63c-89e1ac451de4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:58.032718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:58.055365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464854-f73a-4eeb-93b6-b156f0a3caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:58.056021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464854-f73a-4eeb-93b6-b156f0a3caec None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:58.056335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464854-f73a-4eeb-93b6-b156f0a3caec None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:58.056608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464854-f73a-4eeb-93b6-b156f0a3caec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:58.057395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464854-f73a-4eeb-93b6-b156f0a3caec None admin] RBAC: Adding query filter params (interface=public, service_id=0cf0596396204d66adcae04cd0b0f539, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:58.057718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464854-f73a-4eeb-93b6-b156f0a3caec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:58.059065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464854-f73a-4eeb-93b6-b156f0a3caec None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:58.069020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 509/995] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Jul 14 11:04:57 2022] GET /identity/v3/endpoints?service_id=0cf0596396204d66adcae04cd0b0f539&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:58.070210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:58.140246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:58.168295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9391f3-0ab6-43e5-8b3f-392d5b0a0152 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:58.168607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9391f3-0ab6-43e5-8b3f-392d5b0a0152 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:58.168885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9391f3-0ab6-43e5-8b3f-392d5b0a0152 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:58.170256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 510/996] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:58.175170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9747-3937-4297-a593-3cb6a59c7557 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:58.175467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9747-3937-4297-a593-3cb6a59c7557 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:58.175738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9747-3937-4297-a593-3cb6a59c7557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:58.178828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d385c-ba11-4ced-a079-8d663492bb08 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:58.194174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f20d9747-3937-4297-a593-3cb6a59c7557 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:58.195368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f20d9747-3937-4297-a593-3cb6a59c7557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:58.219007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb168-097e-4e5c-b3b1-49cb3a1c8779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:58.219682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb168-097e-4e5c-b3b1-49cb3a1c8779 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:58.220003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb168-097e-4e5c-b3b1-49cb3a1c8779 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:58.220269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fb168-097e-4e5c-b3b1-49cb3a1c8779 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:58.221020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fb168-097e-4e5c-b3b1-49cb3a1c8779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:58.222354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1fb168-097e-4e5c-b3b1-49cb3a1c8779 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:58.229179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 487/997] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:04:58 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:04:58.285681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 511/998] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:04:58.308373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb168-097e-4e5c-b3b1-49cb3a1c8779 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:58.418164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1fb168-097e-4e5c-b3b1-49cb3a1c8779 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:58.448272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:58.454318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:58.455123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:58.455407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:58.455682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:58.456360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:58.457741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:58.470721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:58.471736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:58.472641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 488/999] 10.222.0.17 () {56 vars in 1126 bytes} [Thu Jul 14 11:04:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:58.481524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d9747-3937-4297-a593-3cb6a59c7557 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:58.595918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d9747-3937-4297-a593-3cb6a59c7557 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:58.603703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:58.632313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:58.632986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:58.633274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:58.633556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:58.634353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:58.634579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:58.635955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:58.645978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 512/1000] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:58.647525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:58.751739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab615671-83b4-45b5-91c1-4d69c2992e6d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:58.785445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b502ecf-cb1d-41bb-bb36-0816e53c49ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:58.786198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b502ecf-cb1d-41bb-bb36-0816e53c49ec None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:58.786451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b502ecf-cb1d-41bb-bb36-0816e53c49ec None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:58.786724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b502ecf-cb1d-41bb-bb36-0816e53c49ec None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:58.787539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b502ecf-cb1d-41bb-bb36-0816e53c49ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:58.787827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b502ecf-cb1d-41bb-bb36-0816e53c49ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:58.789227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b502ecf-cb1d-41bb-bb36-0816e53c49ec None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:58.794382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 489/1001] 10.222.0.17 () {56 vars in 1122 bytes} [Thu Jul 14 11:04:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:58.799979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:58.904673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14017c5b-e9dc-4aaf-bd96-08ee70a79654 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:58.939316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962579c-f0a8-4ab1-ac59-92c29758cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:58.939977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962579c-f0a8-4ab1-ac59-92c29758cdeb None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:58.940307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962579c-f0a8-4ab1-ac59-92c29758cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:58.940581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962579c-f0a8-4ab1-ac59-92c29758cdeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:58.941330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962579c-f0a8-4ab1-ac59-92c29758cdeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:58.942963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962579c-f0a8-4ab1-ac59-92c29758cdeb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:58.959678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 513/1002] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:04:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:04:59.185035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b7272-701a-40fb-808a-06ae6ff2e064 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:59.185323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b7272-701a-40fb-808a-06ae6ff2e064 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:59.185603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b7272-701a-40fb-808a-06ae6ff2e064 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:59.187477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 490/1003] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:04:59.193336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bd2e5-6cfe-445b-a594-9d3665951de8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:59.193625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bd2e5-6cfe-445b-a594-9d3665951de8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:59.193903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bd2e5-6cfe-445b-a594-9d3665951de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:59.211713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8f0bd2e5-6cfe-445b-a594-9d3665951de8 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:04:59.212959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8f0bd2e5-6cfe-445b-a594-9d3665951de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:04:59.238301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:59.296161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 514/1004] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:04:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:04:59.321207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b7272-701a-40fb-808a-06ae6ff2e064 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:59.393989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:59.440056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b7272-701a-40fb-808a-06ae6ff2e064 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:59.474296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:59.475099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:59.475377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:59.475648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] PATH_INFO: `/v3/services/image` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:59.476376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:59.477790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:04:59.490121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:04:59.491121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:04:59.491997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:04:59.496211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 491/1005] 10.222.0.17 () {56 vars in 1105 bytes} [Thu Jul 14 11:04:59 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:04:59.497568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bd2e5-6cfe-445b-a594-9d3665951de8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:59.608871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bd2e5-6cfe-445b-a594-9d3665951de8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:59.645536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb300cb6-bc61-47ce-9e00-f602979f81aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:59.646199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb300cb6-bc61-47ce-9e00-f602979f81aa None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:59.646481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb300cb6-bc61-47ce-9e00-f602979f81aa None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:59.646755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb300cb6-bc61-47ce-9e00-f602979f81aa None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:59.647456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb300cb6-bc61-47ce-9e00-f602979f81aa None admin] RBAC: Adding query filter params (name=image) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:59.647759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb300cb6-bc61-47ce-9e00-f602979f81aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:59.649324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb300cb6-bc61-47ce-9e00-f602979f81aa None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:59.655098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 515/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:04:59.661217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:04:59.763442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1da138-fac3-4981-9cd6-e50c6cc62c9a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:04:59.786163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:04:59.798049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cd8db-f717-4cd8-8f9c-661b6f1a2fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:04:59.798711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd8db-f717-4cd8-8f9c-661b6f1a2fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:04:59.798994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd8db-f717-4cd8-8f9c-661b6f1a2fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:04:59.799269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cd8db-f717-4cd8-8f9c-661b6f1a2fa5 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:04:59.799974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cd8db-f717-4cd8-8f9c-661b6f1a2fa5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:04:59.800352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cd8db-f717-4cd8-8f9c-661b6f1a2fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:04:59.801720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cd8db-f717-4cd8-8f9c-661b6f1a2fa5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:04:59.812200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 492/1007] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:04:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:00.300057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7ce6-b02b-43d6-b64e-67ee598c97fe None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:00.300627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7ce6-b02b-43d6-b64e-67ee598c97fe None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:00.300627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7ce6-b02b-43d6-b64e-67ee598c97fe None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:00.302206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 516/1008] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:00.307178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399248-ddcf-4ef4-a5a7-1a16ce132136 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:00.307472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399248-ddcf-4ef4-a5a7-1a16ce132136 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:00.307753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54399248-ddcf-4ef4-a5a7-1a16ce132136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:00.325600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-54399248-ddcf-4ef4-a5a7-1a16ce132136 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:00.326818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-54399248-ddcf-4ef4-a5a7-1a16ce132136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:00.395378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 493/1009] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:00.418168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7ce6-b02b-43d6-b64e-67ee598c97fe None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:00.441013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:00.524724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7ce6-b02b-43d6-b64e-67ee598c97fe None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:00.564152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:00.564875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:00.565157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:00.565429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:00.566077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:00.567694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:00.579589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:00.580867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 11:05:00.582208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:00.584475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 517/1010] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:05:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:00.586738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54399248-ddcf-4ef4-a5a7-1a16ce132136 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:00.686785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54399248-ddcf-4ef4-a5a7-1a16ce132136 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:00.704812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:00.722329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:00.722993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:00.723272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:00.723543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:00.724268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:00.724571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:00.725934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:00.735733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 494/1011] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:05:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:00.737239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:00.820943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:00.837742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff022-2789-4ded-8d7f-480f05ddd869 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:00.872601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555aab9-59c4-44b8-8f56-06bd55ec75f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:00.873274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555aab9-59c4-44b8-8f56-06bd55ec75f2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:00.873558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555aab9-59c4-44b8-8f56-06bd55ec75f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:00.873835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555aab9-59c4-44b8-8f56-06bd55ec75f2 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:00.874563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555aab9-59c4-44b8-8f56-06bd55ec75f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:00.874868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555aab9-59c4-44b8-8f56-06bd55ec75f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:00.876274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555aab9-59c4-44b8-8f56-06bd55ec75f2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:00.881529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 518/1012] 10.222.0.17 () {56 vars in 1112 bytes} [Thu Jul 14 11:05:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:00.886911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:00.990741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8220-cf26-4b80-859b-6d07ff0554d5 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:01.017003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105a834-59e4-4825-9fe2-0ddfd98e8437 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:01.017301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105a834-59e4-4825-9fe2-0ddfd98e8437 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:01.017574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105a834-59e4-4825-9fe2-0ddfd98e8437 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:01.018963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 519/1013] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:01.023790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0efa9-0a15-44fc-acfa-ac1d20026f33 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:01.024084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0efa9-0a15-44fc-acfa-ac1d20026f33 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:01.024452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0efa9-0a15-44fc-acfa-ac1d20026f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:01.025117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ede2d3-9c21-4b15-b4cc-9fc8a12118b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:01.025743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ede2d3-9c21-4b15-b4cc-9fc8a12118b8 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:01.025983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ede2d3-9c21-4b15-b4cc-9fc8a12118b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:01.026258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ede2d3-9c21-4b15-b4cc-9fc8a12118b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:01.027001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ede2d3-9c21-4b15-b4cc-9fc8a12118b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:01.028934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ede2d3-9c21-4b15-b4cc-9fc8a12118b8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:01.042362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cff0efa9-0a15-44fc-acfa-ac1d20026f33 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:01.043566 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cff0efa9-0a15-44fc-acfa-ac1d20026f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:01.049447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 495/1014] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:05:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:01.139845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 520/1015] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:01 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:05:01.164428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ede2d3-9c21-4b15-b4cc-9fc8a12118b8 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:01.209255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:01.277361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ede2d3-9c21-4b15-b4cc-9fc8a12118b8 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:01.315846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef23f-1be5-4604-91c6-4ec93aed4325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:01.316956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef23f-1be5-4604-91c6-4ec93aed4325 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:01.317380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef23f-1be5-4604-91c6-4ec93aed4325 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:01.317815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef23f-1be5-4604-91c6-4ec93aed4325 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:01.319113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef23f-1be5-4604-91c6-4ec93aed4325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:01.320647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef23f-1be5-4604-91c6-4ec93aed4325 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:01.323898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 496/1016] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:01.329835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0efa9-0a15-44fc-acfa-ac1d20026f33 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:01.410181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:01.437767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0efa9-0a15-44fc-acfa-ac1d20026f33 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:01.473807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82c9aa-e979-4bb7-903d-f786d1909c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:01.474519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c9aa-e979-4bb7-903d-f786d1909c52 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:01.474810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c9aa-e979-4bb7-903d-f786d1909c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:01.475090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82c9aa-e979-4bb7-903d-f786d1909c52 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:01.475803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82c9aa-e979-4bb7-903d-f786d1909c52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:01.477295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82c9aa-e979-4bb7-903d-f786d1909c52 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:01.507765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 521/1017] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:05:01 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:01.850906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ab4b-7c69-45e0-aaed-3419fc403934 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:01.851294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ab4b-7c69-45e0-aaed-3419fc403934 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:01.851471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0ab4b-7c69-45e0-aaed-3419fc403934 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:01.852996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 497/1018] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:01.858212 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802bcc9-ec85-4ca7-960a-1f2339c56576 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:01.858502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802bcc9-ec85-4ca7-960a-1f2339c56576 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:01.858779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802bcc9-ec85-4ca7-960a-1f2339c56576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:01.876013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0802bcc9-ec85-4ca7-960a-1f2339c56576 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:01.877225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0802bcc9-ec85-4ca7-960a-1f2339c56576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:01.944715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 522/1019] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:01 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:01.967034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0ab4b-7c69-45e0-aaed-3419fc403934 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:02.071856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0ab4b-7c69-45e0-aaed-3419fc403934 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:02.078805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:02.105718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6d11a-14f9-4f6c-a506-1e7d953ecb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:02.106837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d11a-14f9-4f6c-a506-1e7d953ecb34 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:02.107113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d11a-14f9-4f6c-a506-1e7d953ecb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:02.107383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6d11a-14f9-4f6c-a506-1e7d953ecb34 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:02.108143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6d11a-14f9-4f6c-a506-1e7d953ecb34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:02.109486 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6d11a-14f9-4f6c-a506-1e7d953ecb34 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:02.126280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 498/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:05:01 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:03.218988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf34dd-80d0-406f-b114-99d38457ad0a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:03.219535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf34dd-80d0-406f-b114-99d38457ad0a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:03.219535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf34dd-80d0-406f-b114-99d38457ad0a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:03.220981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 523/1021] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:03.226061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20914-6434-4053-a981-470af4bf2733 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:03.226451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20914-6434-4053-a981-470af4bf2733 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:03.226636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20914-6434-4053-a981-470af4bf2733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:03.243833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-39c20914-6434-4053-a981-470af4bf2733 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:03.245110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-39c20914-6434-4053-a981-470af4bf2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:03.319872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 499/1022] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:03.347236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf34dd-80d0-406f-b114-99d38457ad0a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:03.411053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:03.457406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf34dd-80d0-406f-b114-99d38457ad0a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:03.491534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9eb30a-ab13-407d-818d-ac857516f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:03.492297 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eb30a-ab13-407d-818d-ac857516f014 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:03.492586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eb30a-ab13-407d-818d-ac857516f014 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:03.492863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9eb30a-ab13-407d-818d-ac857516f014 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:03.504514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9eb30a-ab13-407d-818d-ac857516f014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-9b9eb30a-ab13-407d-818d-ac857516f014 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:03.515552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:03.516593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:05:03.517475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:03.519945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20914-6434-4053-a981-470af4bf2733 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:03.522038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 524/1023] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Jul 14 11:05:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:03.610640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:03.610843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34d7ce-b451-4926-9001-efbcc5cf31dd None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:03.611076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34d7ce-b451-4926-9001-efbcc5cf31dd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:03.611353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34d7ce-b451-4926-9001-efbcc5cf31dd None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:03.616830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 525/1024] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:05:03.618545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee24d5-0319-4273-9dbb-2c23ba22079d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:03.618833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee24d5-0319-4273-9dbb-2c23ba22079d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:03.619255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee24d5-0319-4273-9dbb-2c23ba22079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:03.623005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20914-6434-4053-a981-470af4bf2733 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:03.636401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1eee24d5-0319-4273-9dbb-2c23ba22079d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:03.637743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1eee24d5-0319-4273-9dbb-2c23ba22079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:03.662912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:03.663593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:03.663882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:03.664399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:03.664945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:03.665346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:03.666684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:03.680666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 500/1025] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Jul 14 11:05:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:03.681746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:03.711335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 526/1026] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:03.736491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee24d5-0319-4273-9dbb-2c23ba22079d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:03.783403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:03.791047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f544-38ae-4c48-bee1-7ead1a5b5bb2 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:03.826165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:03.826969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:03.827260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:03.827534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:03.838445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:03.839661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee24d5-0319-4273-9dbb-2c23ba22079d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:03.839904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:05:03.860665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:03.861671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:03.862575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:05:03.862575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:05:03.862575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:03.862575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:03.866767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 501/1027] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:03.867463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:03.878511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:03.883244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdc596-609c-4297-9312-6022de97de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:03.884248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdc596-609c-4297-9312-6022de97de9e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:03.884537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdc596-609c-4297-9312-6022de97de9e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:03.884815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdc596-609c-4297-9312-6022de97de9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:03.886024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdc596-609c-4297-9312-6022de97de9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:03.887484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdc596-609c-4297-9312-6022de97de9e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:03.889197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 527/1028] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:03.894825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdc596-609c-4297-9312-6022de97de9e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:03.992144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628c4f6-7ceb-44a6-86e6-505742812379 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.005693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdc596-609c-4297-9312-6022de97de9e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.020927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:04.032811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.033579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.033807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.034108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.034962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:04.035073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.036411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.043025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78cc8a-b068-4ae6-b5bc-2f50129cd242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.044347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78cc8a-b068-4ae6-b5bc-2f50129cd242 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.044636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78cc8a-b068-4ae6-b5bc-2f50129cd242 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.044921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78cc8a-b068-4ae6-b5bc-2f50129cd242 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.045640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78cc8a-b068-4ae6-b5bc-2f50129cd242 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.047079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78cc8a-b068-4ae6-b5bc-2f50129cd242 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.050433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 502/1029] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:04.056246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:04.071948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 528/1030] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:05:03 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:05:04.141076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:04.179484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c812e6c-5388-4e14-b911-83db57dd26cf None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.198910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ea7f-8f7a-4e43-83d2-6ab6230be08e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.199278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ea7f-8f7a-4e43-83d2-6ab6230be08e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.199614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117ea7f-8f7a-4e43-83d2-6ab6230be08e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.201507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 529/1031] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:05:04.210082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc37db-f51a-4725-a271-67fce6e53e6e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.210082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc37db-f51a-4725-a271-67fce6e53e6e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.210794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc37db-f51a-4725-a271-67fce6e53e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.230775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7edc37db-f51a-4725-a271-67fce6e53e6e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:04.232141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7edc37db-f51a-4725-a271-67fce6e53e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:04.233463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.234169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.235050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.235050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.245986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.247467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:05:04.262728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:04.263758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:04.265492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 503/1032] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:05:04.269816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:04.316995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 530/1033] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:04.340450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc37db-f51a-4725-a271-67fce6e53e6e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:04.377709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2f3a7-5144-4ff3-bdf2-030fb8fb1d3f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.406718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:04.416158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.416834 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.417118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.417397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.418409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:04.418718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.420194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.437483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 504/1034] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:04.444280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:04.461815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:04.464963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc37db-f51a-4725-a271-67fce6e53e6e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.501985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.502787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.503073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.503348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] PATH_INFO: `/v3/services/image` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.504005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.505860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:04.518658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:04.519696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:04.520609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 531/1035] 10.222.0.17 () {56 vars in 1105 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:05:04.525701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:04.563208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef3c36-783a-4f40-bae2-3a5639416126 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.599689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5769f0-6912-44b0-ab11-51483e759665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.600388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5769f0-6912-44b0-ab11-51483e759665 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.600689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5769f0-6912-44b0-ab11-51483e759665 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.600948 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5769f0-6912-44b0-ab11-51483e759665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.634766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20062e7b-534b-4dda-816f-e7694b9ced96 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.656392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:04.672049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.673358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.673646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.674080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.674813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:04.674941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5769f0-6912-44b0-ab11-51483e759665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.675120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.676484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5769f0-6912-44b0-ab11-51483e759665 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.676586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.681688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 532/1036] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:04.687571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:04.717995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:04.789488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 505/1037] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:05:04.794909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5769f0-6912-44b0-ab11-51483e759665 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:04.798809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d64f9-6862-490d-9d91-5e366cf165c2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.834612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.835287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.835568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.835843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.836589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] RBAC: Adding query filter params (type=image) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:04.836894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.838271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.848483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 533/1038] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:04.850239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:04.890544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:04.908077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5769f0-6912-44b0-ab11-51483e759665 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.943302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:04.944085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:04.944393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:04.944665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:04.952150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:04.959129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:04.961097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:04.963238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5620b-3941-4e0c-a9c1-0155ff3e9559 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:05:04.978573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:04.979720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:04.980808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:05:04.980808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:05:04.980808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:04.980808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:04.980808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 506/1039] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:04.986052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:05.006356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:05.007022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:05.007310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:05.007660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:05.008427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] RBAC: Adding query filter params (interface=public, service_id=2cac369071ee41b89d5426d83866f63a, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:05.008741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:05.010190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:05.015681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 534/1040] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/endpoints?service_id=2cac369071ee41b89d5426d83866f63a&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:05.021188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:05.100157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7ff9-78a0-4289-8d68-981b9a14a71e None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:05.128153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9698ac-79f1-465c-81b3-f7625fd5d77e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:05.135911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:05.136621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:05.136904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:05.137199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:05.137922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:05.138225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:05.139597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:05.142032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:05.152780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 507/1041] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:05.158293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:05.172440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da83cc-5c23-455a-8757-80078a103554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:05.173125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da83cc-5c23-455a-8757-80078a103554 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:05.173413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da83cc-5c23-455a-8757-80078a103554 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:05.173694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da83cc-5c23-455a-8757-80078a103554 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:05.174393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da83cc-5c23-455a-8757-80078a103554 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:05.175793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da83cc-5c23-455a-8757-80078a103554 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:05.192148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 535/1042] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:05:05 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:05:05.289836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02ec6-7643-4c95-afdd-92d54c55eea9 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:05.335865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:05.336713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:05.336994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:05.337266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:05.351552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:05.354193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:05:05.374378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:05.375368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:05.377427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 508/1043] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:05:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:05:05.383078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da83cc-5c23-455a-8757-80078a103554 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:05.408342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:05.490984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da83cc-5c23-455a-8757-80078a103554 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:05.537405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299309b-635a-4dd7-9888-0d14f33203c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:05.538607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299309b-635a-4dd7-9888-0d14f33203c6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:05.539098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299309b-635a-4dd7-9888-0d14f33203c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:05.539312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299309b-635a-4dd7-9888-0d14f33203c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:05.540136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299309b-635a-4dd7-9888-0d14f33203c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:05.540457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299309b-635a-4dd7-9888-0d14f33203c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:05.541916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299309b-635a-4dd7-9888-0d14f33203c6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:05.560152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 536/1044] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:05:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:05.562180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:05.635151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:05.682489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf96657-1e5a-4c53-bce2-1611e1482764 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:05.720597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe926-8f7f-4f5b-aea6-be9c892bbe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:05.721273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe926-8f7f-4f5b-aea6-be9c892bbe22 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:05.721558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe926-8f7f-4f5b-aea6-be9c892bbe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:05.721835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe926-8f7f-4f5b-aea6-be9c892bbe22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:05.722687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe926-8f7f-4f5b-aea6-be9c892bbe22 None admin] RBAC: Adding query filter params (role.id=020fbe9bfbb84fec9464ee144ef0181f, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=00b59b80b61a4dec8f4df2bc8a45d340) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:05.722998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe926-8f7f-4f5b-aea6-be9c892bbe22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:05.724491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe926-8f7f-4f5b-aea6-be9c892bbe22 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:05.731415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 509/1045] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:05 2022] GET /identity/v3/role_assignments?user.id=00b59b80b61a4dec8f4df2bc8a45d340&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=020fbe9bfbb84fec9464ee144ef0181f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:06.224376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513466f9-7242-4561-804b-1c471c85d6a2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:06.224798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513466f9-7242-4561-804b-1c471c85d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:06.224987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513466f9-7242-4561-804b-1c471c85d6a2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:06.226349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 537/1046] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:06.232045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030710ba-e517-43b7-af94-21301c623b2a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:06.232369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030710ba-e517-43b7-af94-21301c623b2a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:06.232649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030710ba-e517-43b7-af94-21301c623b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:06.249259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-030710ba-e517-43b7-af94-21301c623b2a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:06.250446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-030710ba-e517-43b7-af94-21301c623b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:06.323687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 510/1047] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:06.347925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513466f9-7242-4561-804b-1c471c85d6a2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:06.433801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:06.455777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513466f9-7242-4561-804b-1c471c85d6a2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:06.493731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5574c-9073-4956-978e-70be35a13f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:06.494454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5574c-9073-4956-978e-70be35a13f81 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:06.494741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5574c-9073-4956-978e-70be35a13f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:06.495018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5574c-9073-4956-978e-70be35a13f81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:06.505284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e5574c-9073-4956-978e-70be35a13f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c8e5574c-9073-4956-978e-70be35a13f81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:06.513447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:06.514392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:06.520097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 538/1048] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:06.522438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030710ba-e517-43b7-af94-21301c623b2a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:06.573553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:06.624499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030710ba-e517-43b7-af94-21301c623b2a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:06.658632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:06.659305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:06.659590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:06.659868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:06.660649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:06.660953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:06.662604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:06.671313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 511/1049] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:06.676845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5574c-9073-4956-978e-70be35a13f81 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:06.776833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5574c-9073-4956-978e-70be35a13f81 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:06.815735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5afcd8-5490-4437-a3f3-95e5bc84ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:06.816681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5afcd8-5490-4437-a3f3-95e5bc84ed24 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:06.817227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5afcd8-5490-4437-a3f3-95e5bc84ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:06.817497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5afcd8-5490-4437-a3f3-95e5bc84ed24 None admin] PATH_INFO: `/v3/users/4e342e6271eb4bdf9eeabf8d65b2b0cb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:06.830717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:06.834526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5afcd8-5490-4437-a3f3-95e5bc84ed24 None admin] RBAC: Authorizing `identity:get_user(user_id=4e342e6271eb4bdf9eeabf8d65b2b0cb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:06.836742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5afcd8-5490-4437-a3f3-95e5bc84ed24 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:06.843466 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 539/1050] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:06 2022] GET /identity/v3/users/4e342e6271eb4bdf9eeabf8d65b2b0cb => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:06.844705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:06.944329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790627e-830e-4fa9-8b00-d243193d3d53 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:06.957711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:06.979611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afa268-fc3e-42e2-9620-61f9fce912cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:06.980306 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa268-fc3e-42e2-9620-61f9fce912cd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:06.980594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa268-fc3e-42e2-9620-61f9fce912cd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:06.980870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afa268-fc3e-42e2-9620-61f9fce912cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.047613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afa268-fc3e-42e2-9620-61f9fce912cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:07.049039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afa268-fc3e-42e2-9620-61f9fce912cd None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:07.153564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 512/1051] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:07.155040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5afcd8-5490-4437-a3f3-95e5bc84ed24 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:07.269579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5afcd8-5490-4437-a3f3-95e5bc84ed24 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:07.305554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1e137-3e06-43f4-87db-6fb4bf174c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:07.306334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e137-3e06-43f4-87db-6fb4bf174c1c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:07.306616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e137-3e06-43f4-87db-6fb4bf174c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:07.306889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e137-3e06-43f4-87db-6fb4bf174c1c None admin] PATH_INFO: `/v3/projects/d1037b3d8f90490191ddbad63c5913c6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.308062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1e137-3e06-43f4-87db-6fb4bf174c1c None admin] RBAC: Authorizing `identity:get_project(project_id=d1037b3d8f90490191ddbad63c5913c6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:07.310175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1e137-3e06-43f4-87db-6fb4bf174c1c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:07.312047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 540/1052] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:07 2022] GET /identity/v3/projects/d1037b3d8f90490191ddbad63c5913c6 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:07.314106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f2eb-7386-4b34-b20e-dedad5604925 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:07.314400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f2eb-7386-4b34-b20e-dedad5604925 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:07.314680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1f2eb-7386-4b34-b20e-dedad5604925 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.316189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 513/1053] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:07.318035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1e137-3e06-43f4-87db-6fb4bf174c1c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:07.321150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb749c1-d4d0-4c67-9c18-ba1bb7683df5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:07.321441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb749c1-d4d0-4c67-9c18-ba1bb7683df5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:07.321719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb749c1-d4d0-4c67-9c18-ba1bb7683df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.342895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-eeb749c1-d4d0-4c67-9c18-ba1bb7683df5 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:07.344086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eeb749c1-d4d0-4c67-9c18-ba1bb7683df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:07.351736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:07.396278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:07.425523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 514/1054] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:05:07.436284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1e137-3e06-43f4-87db-6fb4bf174c1c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:07.449463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb749c1-d4d0-4c67-9c18-ba1bb7683df5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:07.473922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:07.474976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:07.475496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:07.475842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.476735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=d1037b3d8f90490191ddbad63c5913c6, user.id=4e342e6271eb4bdf9eeabf8d65b2b0cb) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:07.477048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:07.478687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:07.488289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 541/1055] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:07 2022] GET /identity/v3/role_assignments?user.id=4e342e6271eb4bdf9eeabf8d65b2b0cb&scope.project.id=d1037b3d8f90490191ddbad63c5913c6&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:07.605388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb749c1-d4d0-4c67-9c18-ba1bb7683df5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:07.653984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b778a-709e-424f-8fb4-deb0996faf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:07.654916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b778a-709e-424f-8fb4-deb0996faf0f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:07.655282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b778a-709e-424f-8fb4-deb0996faf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:07.655558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b778a-709e-424f-8fb4-deb0996faf0f None admin] PATH_INFO: `/v3/services/image` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.656974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b778a-709e-424f-8fb4-deb0996faf0f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:07.657712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b778a-709e-424f-8fb4-deb0996faf0f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-fe0b778a-709e-424f-8fb4-deb0996faf0f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:07.670593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:07.671832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:07.672966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 515/1056] 10.222.0.17 () {56 vars in 1105 bytes} [Thu Jul 14 11:05:07 2022] GET /identity/v3/services/image => generated 86 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:05:07.679400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:07.792662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4982c-8c3b-4e6c-a53c-a4ec0462813e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:07.821996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632244db-2fa9-4db0-841b-4df0c1c90282 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:07.822331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632244db-2fa9-4db0-841b-4df0c1c90282 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:07.822553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632244db-2fa9-4db0-841b-4df0c1c90282 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.823050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:07.823947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 516/1057] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:05:07.829397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb520b-1a8e-45c2-8608-104cdb066583 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:07.829865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb520b-1a8e-45c2-8608-104cdb066583 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:07.830402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb520b-1a8e-45c2-8608-104cdb066583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.833114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:07.833778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:07.834063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:07.834338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:07.835056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] RBAC: Adding query filter params (name=image) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:07.835362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:07.836800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:07.842485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 542/1058] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:07.847394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:07.848180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:07.850643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cebb520b-1a8e-45c2-8608-104cdb066583 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:07.852498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cebb520b-1a8e-45c2-8608-104cdb066583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:07.933151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 517/1059] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:05:07.956570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb520b-1a8e-45c2-8608-104cdb066583 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:07.970139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f8399-694a-4cc9-acc5-d9e8311ba11e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.007534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.008245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.008535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.008812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.009595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:08.009906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.011319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.017295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 543/1060] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:08.022866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:08.064515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb520b-1a8e-45c2-8608-104cdb066583 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.090153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:08.107048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c8972-f942-4ee1-ba35-8aba78c7a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.108224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c8972-f942-4ee1-ba35-8aba78c7a491 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.108723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c8972-f942-4ee1-ba35-8aba78c7a491 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.109194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c8972-f942-4ee1-ba35-8aba78c7a491 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.112749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:08.124653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c8972-f942-4ee1-ba35-8aba78c7a491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:08.135004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316529a-fba2-4d7d-b86a-fea25ae0f7f2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6c5c8972-f942-4ee1-ba35-8aba78c7a491 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:08.135275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:08.136248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:08.137704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 518/1061] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Jul 14 11:05:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:05:08.144124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c8972-f942-4ee1-ba35-8aba78c7a491 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:08.178697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0c64-9505-4d69-b745-7956657a201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.179360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0c64-9505-4d69-b745-7956657a201e None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.179642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0c64-9505-4d69-b745-7956657a201e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.179946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce0c64-9505-4d69-b745-7956657a201e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.180724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce0c64-9505-4d69-b745-7956657a201e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.182101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce0c64-9505-4d69-b745-7956657a201e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.202730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 544/1062] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:05:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:05:08.266232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c8972-f942-4ee1-ba35-8aba78c7a491 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.312056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.312766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.313048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.313318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.314076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:08.314382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.315793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.326870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 519/1063] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Jul 14 11:05:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:08.332595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0c64-9505-4d69-b745-7956657a201e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:08.463806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce0c64-9505-4d69-b745-7956657a201e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.487887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:08.520031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.520944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.521228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.521501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.534464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.536274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:05:08.554399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:08.555439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:08.561853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:05:08.561853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:05:08.561853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:08.561853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:08.561853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 545/1064] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:08.563812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:08.636996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:08.689417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba683-20f1-4439-8d74-7804b9a98d52 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.725023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.725612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.725896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.726180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.726909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:08.727213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.728631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.740938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 520/1065] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:08.747246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:08.855139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e199de-197b-4b6c-bfb8-e32a113cc7ef None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:08.891232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:08.892036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:08.892360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:08.892639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:08.900863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:08.902322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:05:08.916801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:08.917851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:05:08.919332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:08.924162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 546/1066] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:05:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:08.924547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.080023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f116229-1ac2-45c6-bff9-fbf61e5501d1 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:09.095347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:09.119109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:09.119799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.120086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.120388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.121240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:09.121761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:09.123336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:09.144155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 521/1067] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:05:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:09.149371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.193611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:09.280670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa740-6cad-452d-8040-566254146b5e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:09.315270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:09.316333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.316685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.317285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.328969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:09.330643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:05:09.348904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:09.349893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:09.350821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:05:09.350821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:05:09.350821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:09.350821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:09.357102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 547/1068] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:09.357271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.486410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f8c4-3348-48c2-8385-e00a2bb9580f None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:09.525090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098264-d19f-433f-a341-2f533895e350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:09.525667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098264-d19f-433f-a341-2f533895e350 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.525949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098264-d19f-433f-a341-2f533895e350 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.526224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098264-d19f-433f-a341-2f533895e350 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.530444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30098264-d19f-433f-a341-2f533895e350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:09.530444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30098264-d19f-433f-a341-2f533895e350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:09.530444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30098264-d19f-433f-a341-2f533895e350 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:09.542260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 522/1069] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:09.547892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.577219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ef769-ccf8-44d8-9ec2-f16790811a50 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.577996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ef769-ccf8-44d8-9ec2-f16790811a50 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.577996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ef769-ccf8-44d8-9ec2-f16790811a50 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.579627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 523/1070] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:09.585496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6db4-da43-41ee-83d1-7f2b388b935f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.585783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6db4-da43-41ee-83d1-7f2b388b935f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.586055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba6db4-da43-41ee-83d1-7f2b388b935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.603235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-66ba6db4-da43-41ee-83d1-7f2b388b935f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:09.604449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-66ba6db4-da43-41ee-83d1-7f2b388b935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:09.633731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:09.645848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:09.669971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a3b96-caaf-44e0-a2e1-f10c7af5b7a9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:09.680840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 524/1071] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:09.704074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba6db4-da43-41ee-83d1-7f2b388b935f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.705972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:09.706785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.707060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.707341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.714609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:09.716686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:05:09.731429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:09.732439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:09.733509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 548/1072] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:09.738275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.818837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba6db4-da43-41ee-83d1-7f2b388b935f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:09.857566 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdbaab-ef97-4501-8e37-b3ab505a2a65 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:09.858117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200153ea-2a00-4b56-9662-4013490decab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:09.858938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200153ea-2a00-4b56-9662-4013490decab None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.859217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200153ea-2a00-4b56-9662-4013490decab None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.859493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200153ea-2a00-4b56-9662-4013490decab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.871440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200153ea-2a00-4b56-9662-4013490decab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-200153ea-2a00-4b56-9662-4013490decab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:09.879388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:09.881818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:09.883430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 525/1073] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:09.886671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200153ea-2a00-4b56-9662-4013490decab None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.903208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:09.903871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:09.904418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:09.904418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:09.905229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:09.905537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:09.907007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:09.914191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:09.914724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:09.927896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 549/1074] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:09.928819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:09.995598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200153ea-2a00-4b56-9662-4013490decab None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:10.032287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:10.032978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.033255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.033530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.034290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:10.034593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:10.035994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:10.044494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a548d-0871-4be2-9830-068848a41f64 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:10.045741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 526/1075] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:10.051562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:10.102034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897bc83-339c-4c33-9c54-a31e60ba5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:10.103371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bc83-339c-4c33-9c54-a31e60ba5fde None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.103793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bc83-339c-4c33-9c54-a31e60ba5fde None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.104083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897bc83-339c-4c33-9c54-a31e60ba5fde None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/00b59b80b61a4dec8f4df2bc8a45d340/roles/020fbe9bfbb84fec9464ee144ef0181f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.106781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897bc83-339c-4c33-9c54-a31e60ba5fde None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=00b59b80b61a4dec8f4df2bc8a45d340, role_id=020fbe9bfbb84fec9464ee144ef0181f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:10.108707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897bc83-339c-4c33-9c54-a31e60ba5fde None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:10.136146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 550/1076] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:05:09 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/00b59b80b61a4dec8f4df2bc8a45d340/roles/020fbe9bfbb84fec9464ee144ef0181f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:10.178865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:10.202319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816e0a7-b8b0-4719-b6d0-7ed8b2fc8c9d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:10.246000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f4907-e18f-415c-9431-50f08cf854d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:10.247824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f4907-e18f-415c-9431-50f08cf854d8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.248431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f4907-e18f-415c-9431-50f08cf854d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.248852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f4907-e18f-415c-9431-50f08cf854d8 None admin] PATH_INFO: `/v3/users/4e342e6271eb4bdf9eeabf8d65b2b0cb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.250387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f4907-e18f-415c-9431-50f08cf854d8 None admin] RBAC: Authorizing `identity:get_user(user_id=4e342e6271eb4bdf9eeabf8d65b2b0cb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:10.251944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f4907-e18f-415c-9431-50f08cf854d8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:10.256343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 527/1077] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:10 2022] GET /identity/v3/users/4e342e6271eb4bdf9eeabf8d65b2b0cb => generated 285 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:10.260341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897bc83-339c-4c33-9c54-a31e60ba5fde None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:10.322838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b989ba7-6efa-40c7-bedb-1c39c27b27ef None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.323188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b989ba7-6efa-40c7-bedb-1c39c27b27ef None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.323473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b989ba7-6efa-40c7-bedb-1c39c27b27ef None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.324990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 528/1078] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:05:10.331173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcd243-6386-4590-854a-c82a6f671d33 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.331600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcd243-6386-4590-854a-c82a6f671d33 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.331950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcd243-6386-4590-854a-c82a6f671d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.334084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:10.350851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-47bcd243-6386-4590-854a-c82a6f671d33 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:10.352124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-47bcd243-6386-4590-854a-c82a6f671d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:10.386810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897bc83-339c-4c33-9c54-a31e60ba5fde None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:10.424612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bda1b-2efc-486c-8b06-77de51d6f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:10.425474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bda1b-2efc-486c-8b06-77de51d6f339 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.425758 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bda1b-2efc-486c-8b06-77de51d6f339 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.426125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bda1b-2efc-486c-8b06-77de51d6f339 None admin] PATH_INFO: `/v3/projects/d1037b3d8f90490191ddbad63c5913c6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.427584 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bda1b-2efc-486c-8b06-77de51d6f339 None admin] RBAC: Authorizing `identity:get_project(project_id=d1037b3d8f90490191ddbad63c5913c6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:10.429141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bda1b-2efc-486c-8b06-77de51d6f339 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:10.432273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 551/1079] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:10 2022] GET /identity/v3/projects/d1037b3d8f90490191ddbad63c5913c6 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:10.438830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bda1b-2efc-486c-8b06-77de51d6f339 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:10.446633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 529/1080] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:05:10.470762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcd243-6386-4590-854a-c82a6f671d33 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:10.550596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bda1b-2efc-486c-8b06-77de51d6f339 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:10.563755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:10.580484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:10.583565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcd243-6386-4590-854a-c82a6f671d33 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:10.591337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590171-e0e6-4002-bbd4-9e14fa1d1f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:10.592406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590171-e0e6-4002-bbd4-9e14fa1d1f5a None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.592694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590171-e0e6-4002-bbd4-9e14fa1d1f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.592988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81590171-e0e6-4002-bbd4-9e14fa1d1f5a None admin] PATH_INFO: `/v3/projects/d1037b3d8f90490191ddbad63c5913c6/users/4e342e6271eb4bdf9eeabf8d65b2b0cb/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.595055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81590171-e0e6-4002-bbd4-9e14fa1d1f5a None admin] RBAC: Authorizing `identity:create_grant(project_id=d1037b3d8f90490191ddbad63c5913c6, user_id=4e342e6271eb4bdf9eeabf8d65b2b0cb, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:10.596657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81590171-e0e6-4002-bbd4-9e14fa1d1f5a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:10.620139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 552/1081] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:05:10 2022] PUT /identity/v3/projects/d1037b3d8f90490191ddbad63c5913c6/users/4e342e6271eb4bdf9eeabf8d65b2b0cb/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:05:10.632582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b62b7-4b51-4f4e-96f1-843f7ee9dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:10.633649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b62b7-4b51-4f4e-96f1-843f7ee9dd66 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.633944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b62b7-4b51-4f4e-96f1-843f7ee9dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.634225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b62b7-4b51-4f4e-96f1-843f7ee9dd66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.712977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b62b7-4b51-4f4e-96f1-843f7ee9dd66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:10.714410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b62b7-4b51-4f4e-96f1-843f7ee9dd66 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:10.804545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:10.828133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 530/1082] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:05:10.830775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590171-e0e6-4002-bbd4-9e14fa1d1f5a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:10.932766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81590171-e0e6-4002-bbd4-9e14fa1d1f5a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:10.967498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287076de-9e12-4b6f-8d55-00f775cc8abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:10.968263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287076de-9e12-4b6f-8d55-00f775cc8abf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:10.968550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287076de-9e12-4b6f-8d55-00f775cc8abf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:10.968826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287076de-9e12-4b6f-8d55-00f775cc8abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:10.980289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287076de-9e12-4b6f-8d55-00f775cc8abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:10.981781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287076de-9e12-4b6f-8d55-00f775cc8abf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-287076de-9e12-4b6f-8d55-00f775cc8abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:05:10.998910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:10.999833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:11.005646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:05:11.005646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:05:11.005646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:11.005646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:11.005646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 553/1083] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:05:11.007484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b62b7-4b51-4f4e-96f1-843f7ee9dd66 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:11.115632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b62b7-4b51-4f4e-96f1-843f7ee9dd66 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:11.150346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bcecc-088e-4f03-a420-6c5e0c5c2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:11.151304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bcecc-088e-4f03-a420-6c5e0c5c2e29 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:11.151798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bcecc-088e-4f03-a420-6c5e0c5c2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:11.152288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bcecc-088e-4f03-a420-6c5e0c5c2e29 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:11.153803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bcecc-088e-4f03-a420-6c5e0c5c2e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:11.154318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bcecc-088e-4f03-a420-6c5e0c5c2e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:11.155881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bcecc-088e-4f03-a420-6c5e0c5c2e29 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:11.167761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 531/1084] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:12.218888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac980d-05c0-45c4-adc6-6cc953c313b7 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.219419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac980d-05c0-45c4-adc6-6cc953c313b7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.219510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac980d-05c0-45c4-adc6-6cc953c313b7 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.220854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 554/1085] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:12.226096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c6d6e-e3ed-4048-b1a5-6a137c9624e1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.226509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c6d6e-e3ed-4048-b1a5-6a137c9624e1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.226653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c6d6e-e3ed-4048-b1a5-6a137c9624e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.244191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a49c6d6e-e3ed-4048-b1a5-6a137c9624e1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:12.245402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a49c6d6e-e3ed-4048-b1a5-6a137c9624e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:12.279862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:12.311647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 532/1086] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:12.335530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac980d-05c0-45c4-adc6-6cc953c313b7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:12.376398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:12.451996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac980d-05c0-45c4-adc6-6cc953c313b7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:12.485538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968fdf-5a42-4321-8062-9615b915d2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:12.486278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968fdf-5a42-4321-8062-9615b915d2de None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.486558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968fdf-5a42-4321-8062-9615b915d2de None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.486828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968fdf-5a42-4321-8062-9615b915d2de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.497155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1968fdf-5a42-4321-8062-9615b915d2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a1968fdf-5a42-4321-8062-9615b915d2de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:12.505364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:12.506455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 11:05:12.507439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:12.512613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 555/1087] 10.222.0.17 () {56 vars in 1120 bytes} [Thu Jul 14 11:05:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:12.512980 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c6d6e-e3ed-4048-b1a5-6a137c9624e1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:12.613265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c6d6e-e3ed-4048-b1a5-6a137c9624e1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:12.643635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d046e23-558c-4401-8e8d-6dffd338414c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.644037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d046e23-558c-4401-8e8d-6dffd338414c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.644363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d046e23-558c-4401-8e8d-6dffd338414c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.645742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 556/1088] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:05:12.646682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:12.647345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.647623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.647894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.648666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:12.648970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:12.650332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:12.650628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed33ae-3786-4e62-a851-1dd0e8aa8f87 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.650927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed33ae-3786-4e62-a851-1dd0e8aa8f87 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.651206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed33ae-3786-4e62-a851-1dd0e8aa8f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.659037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 533/1089] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Jul 14 11:05:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:12.664547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:12.668357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-97ed33ae-3786-4e62-a851-1dd0e8aa8f87 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:12.669575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-97ed33ae-3786-4e62-a851-1dd0e8aa8f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:12.697349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:12.736060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 557/1090] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:05:12.764651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed33ae-3786-4e62-a851-1dd0e8aa8f87 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:12.772803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18ecf7-55a4-43ee-b11f-2bf9f8550a85 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:12.793561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:12.808330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:12.809661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.809947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.810228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.821609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:12.823069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:05:12.840487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:12.841604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:12.842725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:05:12.842725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:05:12.842725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:12.842725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:12.842725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 534/1091] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:05:12.847338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:12.863941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed33ae-3786-4e62-a851-1dd0e8aa8f87 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:12.898568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985a4be-15d7-4f44-adf2-d31598b2eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:12.899369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985a4be-15d7-4f44-adf2-d31598b2eba1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.899653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985a4be-15d7-4f44-adf2-d31598b2eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.899930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985a4be-15d7-4f44-adf2-d31598b2eba1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.910742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985a4be-15d7-4f44-adf2-d31598b2eba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2985a4be-15d7-4f44-adf2-d31598b2eba1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:12.918824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:12.920201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:12.921137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 558/1092] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:12.926061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985a4be-15d7-4f44-adf2-d31598b2eba1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:12.931690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:12.947562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380765c-043e-4cc8-82f5-55efae829eb0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:12.981503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:12.982169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:12.982452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:12.982729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:12.983460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:12.983798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:12.985175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:12.997219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 535/1093] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:13.002711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.016028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:13.028533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985a4be-15d7-4f44-adf2-d31598b2eba1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.062663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.063332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.063618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.063910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.064700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:13.065010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.066408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.076161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 559/1094] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:13.081861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.101880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6abbf-d5e9-4d9a-a2a5-ddf62fa15763 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.135954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.136778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.137079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.137885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.145431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.146890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:05:13.161643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:13.162818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:13.163810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 536/1095] 10.222.0.17 () {56 vars in 1093 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:13.168998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.177641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:13.181597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a3e7c-fde4-4f54-a262-194ff625be0a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.215589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe54d-9eb0-4a84-af8c-ed3d970fb2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.216496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe54d-9eb0-4a84-af8c-ed3d970fb2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.216776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe54d-9eb0-4a84-af8c-ed3d970fb2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.217053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfe54d-9eb0-4a84-af8c-ed3d970fb2f7 None admin] PATH_INFO: `/v3/users/4e342e6271eb4bdf9eeabf8d65b2b0cb` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.218244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfe54d-9eb0-4a84-af8c-ed3d970fb2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=4e342e6271eb4bdf9eeabf8d65b2b0cb)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.219675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfe54d-9eb0-4a84-af8c-ed3d970fb2f7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.221342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 560/1096] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/users/4e342e6271eb4bdf9eeabf8d65b2b0cb => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:13.226960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe54d-9eb0-4a84-af8c-ed3d970fb2f7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.247364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:13.273338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947de577-c3ac-4483-aac4-e1912bdb3ea4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.307308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.307974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.308290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.308571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.309976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:13.310286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.311721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.325770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfe54d-9eb0-4a84-af8c-ed3d970fb2f7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.329235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 537/1097] 10.222.0.17 () {56 vars in 1133 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:13.334919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.358300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ae421-765f-494f-bf47-8c49d6d3d44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.359071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae421-765f-494f-bf47-8c49d6d3d44c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.359228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae421-765f-494f-bf47-8c49d6d3d44c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.359507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ae421-765f-494f-bf47-8c49d6d3d44c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.398937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:13.426379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ae421-765f-494f-bf47-8c49d6d3d44c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.427842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ae421-765f-494f-bf47-8c49d6d3d44c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.438207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8f6c8-dd0f-4479-b7b6-1da8e90d1f8d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.445532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:13.473126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e6649-3b36-41c4-af09-e07f44d06ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.474149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e6649-3b36-41c4-af09-e07f44d06ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.474433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e6649-3b36-41c4-af09-e07f44d06ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.474710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e6649-3b36-41c4-af09-e07f44d06ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.544810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 561/1098] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:05:13.545816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ae421-765f-494f-bf47-8c49d6d3d44c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.552675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e6649-3b36-41c4-af09-e07f44d06ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.554138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e6649-3b36-41c4-af09-e07f44d06ac6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.618034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:13.643047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ae421-765f-494f-bf47-8c49d6d3d44c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.660848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 538/1099] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:13.661031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:13.661735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e6649-3b36-41c4-af09-e07f44d06ac6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.678788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342794a-1242-4ddf-91f3-bd6f3e7f223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.679648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342794a-1242-4ddf-91f3-bd6f3e7f223f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.679924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342794a-1242-4ddf-91f3-bd6f3e7f223f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.680225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342794a-1242-4ddf-91f3-bd6f3e7f223f None admin] PATH_INFO: `/v3/projects/d1037b3d8f90490191ddbad63c5913c6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.681386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342794a-1242-4ddf-91f3-bd6f3e7f223f None admin] RBAC: Authorizing `identity:get_project(project_id=d1037b3d8f90490191ddbad63c5913c6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.682816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342794a-1242-4ddf-91f3-bd6f3e7f223f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.684621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 562/1100] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/projects/d1037b3d8f90490191ddbad63c5913c6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:13.690443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342794a-1242-4ddf-91f3-bd6f3e7f223f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.759776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e6649-3b36-41c4-af09-e07f44d06ac6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.787944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342794a-1242-4ddf-91f3-bd6f3e7f223f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.794794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.795583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.795864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.796161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.806391 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.807835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.820581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.821231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.821515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.821794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.822621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=d1037b3d8f90490191ddbad63c5913c6, user.id=4e342e6271eb4bdf9eeabf8d65b2b0cb) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:13.822932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.824393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:05:13.825348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:13.826383 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:13.827298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:05:13.827298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:05:13.827298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:05:13.827298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:13.836081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 563/1101] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/role_assignments?user.id=4e342e6271eb4bdf9eeabf8d65b2b0cb&scope.project.id=d1037b3d8f90490191ddbad63c5913c6&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:13.836329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 539/1102] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:13.836423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:13.884667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:13.938225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f9c83-8414-4341-9c12-6ac6aae55297 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:13.975206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:13.975872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:13.976176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:13.976456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:13.977187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:13.977494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:13.978889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:13.991524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 564/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:13.997108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:14.015610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:14.098625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23838d02-4401-47f3-8fa0-17c18a8f9b02 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:14.131553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:14.132384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:14.132673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:14.132950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:14.140083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:14.141557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:05:14.155653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:14.156734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:14.158093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:05:14.158093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:05:14.158093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:05:14.158093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:05:14.158093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:05:14.158093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:05:14.158093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:05:14.158093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:14.160264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 540/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:14.162587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:14.272544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf0c64-6a9d-4602-b00d-b22f1f05cee5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:14.284121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:14.307556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa542c9-b688-4388-a4b8-8087c649c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:14.308247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa542c9-b688-4388-a4b8-8087c649c370 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:14.308537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa542c9-b688-4388-a4b8-8087c649c370 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:14.308820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa542c9-b688-4388-a4b8-8087c649c370 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:14.310144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa542c9-b688-4388-a4b8-8087c649c370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:14.310458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa542c9-b688-4388-a4b8-8087c649c370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:14.311921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa542c9-b688-4388-a4b8-8087c649c370 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:14.324237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 565/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:14.330760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:14.420615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:14.444629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fef7e1-9f9d-49ad-a6f5-578f17e5bcd0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:14.477331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b1b84-a299-451d-a9fc-e1176e72be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:14.477986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1b84-a299-451d-a9fc-e1176e72be24 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:14.478271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1b84-a299-451d-a9fc-e1176e72be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:14.478548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b1b84-a299-451d-a9fc-e1176e72be24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:14.479381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1b84-a299-451d-a9fc-e1176e72be24 None admin] RBAC: Adding query filter params (role.id=020fbe9bfbb84fec9464ee144ef0181f, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=00b59b80b61a4dec8f4df2bc8a45d340) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:14.479871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1b84-a299-451d-a9fc-e1176e72be24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:14.481397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b1b84-a299-451d-a9fc-e1176e72be24 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:14.487332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 541/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:14 2022] GET /identity/v3/role_assignments?user.id=00b59b80b61a4dec8f4df2bc8a45d340&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=020fbe9bfbb84fec9464ee144ef0181f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:15.924082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5867-76c2-411e-8017-172d295798ee None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:15.924750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5867-76c2-411e-8017-172d295798ee None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:15.924750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5867-76c2-411e-8017-172d295798ee None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:15.926040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 566/1107] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:15.931207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95985c-2e74-4c28-a1cd-5124fd26a9e0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:15.931638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95985c-2e74-4c28-a1cd-5124fd26a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:15.931743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95985c-2e74-4c28-a1cd-5124fd26a9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:15.948336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8a95985c-2e74-4c28-a1cd-5124fd26a9e0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:15.949543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8a95985c-2e74-4c28-a1cd-5124fd26a9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:16.012967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 542/1108] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:16.037562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5867-76c2-411e-8017-172d295798ee None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:16.136667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5867-76c2-411e-8017-172d295798ee None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:16.169743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84ca15-f66e-495f-adfb-68f8e73f27b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:16.170521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84ca15-f66e-495f-adfb-68f8e73f27b8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:16.170803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84ca15-f66e-495f-adfb-68f8e73f27b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:16.171075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84ca15-f66e-495f-adfb-68f8e73f27b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:16.172271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84ca15-f66e-495f-adfb-68f8e73f27b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:16.173706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84ca15-f66e-495f-adfb-68f8e73f27b8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:16.175366 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 567/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:16.181156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95985c-2e74-4c28-a1cd-5124fd26a9e0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:16.255706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:16.288166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95985c-2e74-4c28-a1cd-5124fd26a9e0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:16.322065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e2ca7-0b17-42e3-9e1b-12e78f7d2495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:16.322737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2ca7-0b17-42e3-9e1b-12e78f7d2495 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:16.323016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2ca7-0b17-42e3-9e1b-12e78f7d2495 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:16.323286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e2ca7-0b17-42e3-9e1b-12e78f7d2495 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:16.323989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e2ca7-0b17-42e3-9e1b-12e78f7d2495 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:16.325988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e2ca7-0b17-42e3-9e1b-12e78f7d2495 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:16.346094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 543/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:05:16 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:18.408813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895888f-ca8e-45c9-a299-5bcee8580602 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:18.409376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895888f-ca8e-45c9-a299-5bcee8580602 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:18.409376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895888f-ca8e-45c9-a299-5bcee8580602 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:18.410753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 568/1111] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:18.416018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf228-7c82-4d70-9e54-ca68a3ab5651 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:18.416472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf228-7c82-4d70-9e54-ca68a3ab5651 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:18.416606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bdf228-7c82-4d70-9e54-ca68a3ab5651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:18.433185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-98bdf228-7c82-4d70-9e54-ca68a3ab5651 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:18.434998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98bdf228-7c82-4d70-9e54-ca68a3ab5651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:18.498488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 544/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:18.521759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895888f-ca8e-45c9-a299-5bcee8580602 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:18.564294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:18.623765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895888f-ca8e-45c9-a299-5bcee8580602 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:18.655325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833a211-e872-45bc-a793-08096d3118a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:18.656195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a211-e872-45bc-a793-08096d3118a3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:18.656476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a211-e872-45bc-a793-08096d3118a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:18.656747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833a211-e872-45bc-a793-08096d3118a3 None admin] PATH_INFO: `/v3/roles/9189b2de997c4913bc3d3b88754b8966` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:18.658190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833a211-e872-45bc-a793-08096d3118a3 None admin] RBAC: Authorizing `identity:get_role(role_id=9189b2de997c4913bc3d3b88754b8966)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:18.659612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833a211-e872-45bc-a793-08096d3118a3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:18.660949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 569/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:18 2022] GET /identity/v3/roles/9189b2de997c4913bc3d3b88754b8966 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:18.666742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf228-7c82-4d70-9e54-ca68a3ab5651 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:18.721430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:18.764556 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bdf228-7c82-4d70-9e54-ca68a3ab5651 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:18.797739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ab97-cac3-40e0-8cc3-c73b3d7c9470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:18.798602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ab97-cac3-40e0-8cc3-c73b3d7c9470 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:18.798886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ab97-cac3-40e0-8cc3-c73b3d7c9470 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:18.799160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ab97-cac3-40e0-8cc3-c73b3d7c9470 None admin] PATH_INFO: `/v3/users/b0b30d1e62cd418abea1c9b3e938a2e5` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:18.811923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9ab97-cac3-40e0-8cc3-c73b3d7c9470 None admin] RBAC: Authorizing `identity:get_user(user_id=b0b30d1e62cd418abea1c9b3e938a2e5)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:18.813389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9ab97-cac3-40e0-8cc3-c73b3d7c9470 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:18.815045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 545/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:18 2022] GET /identity/v3/users/b0b30d1e62cd418abea1c9b3e938a2e5 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:18.820987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833a211-e872-45bc-a793-08096d3118a3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:18.916171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833a211-e872-45bc-a793-08096d3118a3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:18.924951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:18.950468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3968f9-ad9c-402a-ae7c-739d7e79a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:18.951106 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3968f9-ad9c-402a-ae7c-739d7e79a217 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:18.951387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3968f9-ad9c-402a-ae7c-739d7e79a217 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:18.951662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3968f9-ad9c-402a-ae7c-739d7e79a217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:19.015605 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3968f9-ad9c-402a-ae7c-739d7e79a217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:19.017109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3968f9-ad9c-402a-ae7c-739d7e79a217 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:19.110406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 570/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:19.116449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ab97-cac3-40e0-8cc3-c73b3d7c9470 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:19.214264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ab97-cac3-40e0-8cc3-c73b3d7c9470 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:19.228959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:19.248557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e16388-c373-4bf2-821d-1ce4ba6f7cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:19.249414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16388-c373-4bf2-821d-1ce4ba6f7cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:19.249694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16388-c373-4bf2-821d-1ce4ba6f7cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:19.249966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e16388-c373-4bf2-821d-1ce4ba6f7cd8 None admin] PATH_INFO: `/v3/projects/d1037b3d8f90490191ddbad63c5913c6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:19.251123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e16388-c373-4bf2-821d-1ce4ba6f7cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=d1037b3d8f90490191ddbad63c5913c6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:19.252596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e16388-c373-4bf2-821d-1ce4ba6f7cd8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:19.254296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 546/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:19 2022] GET /identity/v3/projects/d1037b3d8f90490191ddbad63c5913c6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:19.260428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3968f9-ad9c-402a-ae7c-739d7e79a217 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:19.269061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:19.360394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3968f9-ad9c-402a-ae7c-739d7e79a217 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:19.393511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b275410-ba57-4aef-b190-d92c0b29fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:19.394170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275410-ba57-4aef-b190-d92c0b29fb34 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:19.394453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275410-ba57-4aef-b190-d92c0b29fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:19.394729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b275410-ba57-4aef-b190-d92c0b29fb34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:19.395559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b275410-ba57-4aef-b190-d92c0b29fb34 None admin] RBAC: Adding query filter params (role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=d1037b3d8f90490191ddbad63c5913c6, user.id=b0b30d1e62cd418abea1c9b3e938a2e5) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:19.395865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b275410-ba57-4aef-b190-d92c0b29fb34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:19.397346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b275410-ba57-4aef-b190-d92c0b29fb34 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:19.403440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 571/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:19 2022] GET /identity/v3/role_assignments?user.id=b0b30d1e62cd418abea1c9b3e938a2e5&scope.project.id=d1037b3d8f90490191ddbad63c5913c6&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:21.432308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f2a5e-cb85-44a4-ac75-a18c0a651294 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:21.432871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f2a5e-cb85-44a4-ac75-a18c0a651294 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:21.432871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f2a5e-cb85-44a4-ac75-a18c0a651294 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:21.434795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 547/1118] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:21.440036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e2945-6de7-45ae-a66a-ac0174d07688 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:21.440493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e2945-6de7-45ae-a66a-ac0174d07688 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:21.440605 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e2945-6de7-45ae-a66a-ac0174d07688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:21.457107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-203e2945-6de7-45ae-a66a-ac0174d07688 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:21.458295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-203e2945-6de7-45ae-a66a-ac0174d07688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:21.518530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:21.523624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 572/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:21.547668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f2a5e-cb85-44a4-ac75-a18c0a651294 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:21.658586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f2a5e-cb85-44a4-ac75-a18c0a651294 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:21.694492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77893f17-b6ff-46d3-a78b-1ab1f61572f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:21.695265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77893f17-b6ff-46d3-a78b-1ab1f61572f3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:21.695545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77893f17-b6ff-46d3-a78b-1ab1f61572f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:21.695817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77893f17-b6ff-46d3-a78b-1ab1f61572f3 None admin] PATH_INFO: `/v3/roles/9189b2de997c4913bc3d3b88754b8966` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:21.697306 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77893f17-b6ff-46d3-a78b-1ab1f61572f3 None admin] RBAC: Authorizing `identity:get_role(role_id=9189b2de997c4913bc3d3b88754b8966)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:21.698674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77893f17-b6ff-46d3-a78b-1ab1f61572f3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:21.700079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 548/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:21 2022] GET /identity/v3/roles/9189b2de997c4913bc3d3b88754b8966 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:05:21.705928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e2945-6de7-45ae-a66a-ac0174d07688 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:21.804266 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e2945-6de7-45ae-a66a-ac0174d07688 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:21.837341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e025-fec3-458f-aa3f-6c691aa618ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:21.838205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e025-fec3-458f-aa3f-6c691aa618ef None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:21.838489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e025-fec3-458f-aa3f-6c691aa618ef None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:21.838767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e025-fec3-458f-aa3f-6c691aa618ef None admin] PATH_INFO: `/v3/users/b0b30d1e62cd418abea1c9b3e938a2e5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:21.839940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0e025-fec3-458f-aa3f-6c691aa618ef None admin] RBAC: Authorizing `identity:get_user(user_id=b0b30d1e62cd418abea1c9b3e938a2e5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:21.841926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0e025-fec3-458f-aa3f-6c691aa618ef None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:21.843553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 573/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:21 2022] GET /identity/v3/users/b0b30d1e62cd418abea1c9b3e938a2e5 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:21.849411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77893f17-b6ff-46d3-a78b-1ab1f61572f3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:21.902432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:21.951843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77893f17-b6ff-46d3-a78b-1ab1f61572f3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:21.985963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc9ce0-7db2-47d8-979c-d8e4218a6b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:21.986812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc9ce0-7db2-47d8-979c-d8e4218a6b47 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:21.987091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc9ce0-7db2-47d8-979c-d8e4218a6b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:21.987367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc9ce0-7db2-47d8-979c-d8e4218a6b47 None admin] PATH_INFO: `/v3/projects/d1037b3d8f90490191ddbad63c5913c6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:21.988563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc9ce0-7db2-47d8-979c-d8e4218a6b47 None admin] RBAC: Authorizing `identity:get_project(project_id=d1037b3d8f90490191ddbad63c5913c6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:21.989994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc9ce0-7db2-47d8-979c-d8e4218a6b47 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:21.991697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 549/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:21 2022] GET /identity/v3/projects/d1037b3d8f90490191ddbad63c5913c6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:21.997921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e025-fec3-458f-aa3f-6c691aa618ef None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:22.063155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:22.096539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e025-fec3-458f-aa3f-6c691aa618ef None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:22.129197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310418cc-6c1f-41f6-9df9-93f2d2f5d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:22.130078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310418cc-6c1f-41f6-9df9-93f2d2f5d4b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:22.130358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310418cc-6c1f-41f6-9df9-93f2d2f5d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:22.130629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310418cc-6c1f-41f6-9df9-93f2d2f5d4b9 None admin] PATH_INFO: `/v3/projects/d1037b3d8f90490191ddbad63c5913c6/users/b0b30d1e62cd418abea1c9b3e938a2e5/roles/9189b2de997c4913bc3d3b88754b8966` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:22.132853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310418cc-6c1f-41f6-9df9-93f2d2f5d4b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1037b3d8f90490191ddbad63c5913c6, user_id=b0b30d1e62cd418abea1c9b3e938a2e5, role_id=9189b2de997c4913bc3d3b88754b8966)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:22.134310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310418cc-6c1f-41f6-9df9-93f2d2f5d4b9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:22.147551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 574/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:05:21 2022] PUT /identity/v3/projects/d1037b3d8f90490191ddbad63c5913c6/users/b0b30d1e62cd418abea1c9b3e938a2e5/roles/9189b2de997c4913bc3d3b88754b8966 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:24.173485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91544d-088f-4191-b63e-22961924ddf3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:24.174016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91544d-088f-4191-b63e-22961924ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:24.174016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91544d-088f-4191-b63e-22961924ddf3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:24.175399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 550/1124] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:24.180620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2a19-ae88-4093-abbc-37a5caba1d53 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:24.181036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2a19-ae88-4093-abbc-37a5caba1d53 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:24.181184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf2a19-ae88-4093-abbc-37a5caba1d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:24.197893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ceaf2a19-ae88-4093-abbc-37a5caba1d53 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:24.199168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ceaf2a19-ae88-4093-abbc-37a5caba1d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:24.264001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 575/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:24.288399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91544d-088f-4191-b63e-22961924ddf3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:24.385197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91544d-088f-4191-b63e-22961924ddf3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:24.402095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:24.419126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318a37-e597-4016-8e7f-515a74782fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:24.419970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318a37-e597-4016-8e7f-515a74782fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:24.420284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318a37-e597-4016-8e7f-515a74782fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:24.420559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3318a37-e597-4016-8e7f-515a74782fa6 None admin] PATH_INFO: `/v3/roles/9189b2de997c4913bc3d3b88754b8966` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:24.422002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3318a37-e597-4016-8e7f-515a74782fa6 None admin] RBAC: Authorizing `identity:get_role(role_id=9189b2de997c4913bc3d3b88754b8966)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:24.423362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3318a37-e597-4016-8e7f-515a74782fa6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:24.424827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 551/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:24 2022] GET /identity/v3/roles/9189b2de997c4913bc3d3b88754b8966 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:24.430668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2a19-ae88-4093-abbc-37a5caba1d53 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:24.497374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:24.540765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf2a19-ae88-4093-abbc-37a5caba1d53 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:24.575738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c8f8-b4ad-4e63-89ea-6ff79b52e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:24.576651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c8f8-b4ad-4e63-89ea-6ff79b52e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:24.576937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c8f8-b4ad-4e63-89ea-6ff79b52e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:24.577214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9c8f8-b4ad-4e63-89ea-6ff79b52e8b6 None admin] PATH_INFO: `/v3/users/b0b30d1e62cd418abea1c9b3e938a2e5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:24.578399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9c8f8-b4ad-4e63-89ea-6ff79b52e8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=b0b30d1e62cd418abea1c9b3e938a2e5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:24.579830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9c8f8-b4ad-4e63-89ea-6ff79b52e8b6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:24.581494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 576/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:24 2022] GET /identity/v3/users/b0b30d1e62cd418abea1c9b3e938a2e5 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:24.587308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318a37-e597-4016-8e7f-515a74782fa6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:24.687949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3318a37-e597-4016-8e7f-515a74782fa6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:24.723334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d563d3-3ef4-473f-8b24-d02f24ac172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:24.723986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d563d3-3ef4-473f-8b24-d02f24ac172b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:24.724298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d563d3-3ef4-473f-8b24-d02f24ac172b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:24.724573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d563d3-3ef4-473f-8b24-d02f24ac172b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:24.777436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:24.791280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d563d3-3ef4-473f-8b24-d02f24ac172b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:24.792773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d563d3-3ef4-473f-8b24-d02f24ac172b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:24.888284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 552/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:24.894452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c8f8-b4ad-4e63-89ea-6ff79b52e8b6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:24.992405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9c8f8-b4ad-4e63-89ea-6ff79b52e8b6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:25.017489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:25.026298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e01af-6ab6-4b60-b458-be934eefd667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:25.027163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e01af-6ab6-4b60-b458-be934eefd667 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:25.027446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e01af-6ab6-4b60-b458-be934eefd667 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:25.027723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e01af-6ab6-4b60-b458-be934eefd667 None admin] PATH_INFO: `/v3/projects/d1037b3d8f90490191ddbad63c5913c6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:25.028920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e01af-6ab6-4b60-b458-be934eefd667 None admin] RBAC: Authorizing `identity:get_project(project_id=d1037b3d8f90490191ddbad63c5913c6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:25.030363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e01af-6ab6-4b60-b458-be934eefd667 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:25.032060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 577/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:24 2022] GET /identity/v3/projects/d1037b3d8f90490191ddbad63c5913c6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:25.038312 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d563d3-3ef4-473f-8b24-d02f24ac172b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:25.120358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:25.135954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d563d3-3ef4-473f-8b24-d02f24ac172b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:25.169479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ff1ca-f211-4103-87fc-fa80fe44e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:25.170123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff1ca-f211-4103-87fc-fa80fe44e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:25.170404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff1ca-f211-4103-87fc-fa80fe44e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:25.170678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff1ca-f211-4103-87fc-fa80fe44e9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:25.171497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ff1ca-f211-4103-87fc-fa80fe44e9c0 None admin] RBAC: Adding query filter params (role.id=9189b2de997c4913bc3d3b88754b8966, scope.project.id=d1037b3d8f90490191ddbad63c5913c6, user.id=b0b30d1e62cd418abea1c9b3e938a2e5) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:25.171808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ff1ca-f211-4103-87fc-fa80fe44e9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:25.173259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ff1ca-f211-4103-87fc-fa80fe44e9c0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:25.179009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 553/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:25 2022] GET /identity/v3/role_assignments?user.id=b0b30d1e62cd418abea1c9b3e938a2e5&scope.project.id=d1037b3d8f90490191ddbad63c5913c6&role.id=9189b2de997c4913bc3d3b88754b8966 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:27.244024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd075-0477-4f7d-a528-185b8a8b30dd None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:27.244594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd075-0477-4f7d-a528-185b8a8b30dd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:27.244801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd075-0477-4f7d-a528-185b8a8b30dd None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:27.246184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 578/1131] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:27.251309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931e4dc-3924-4fd7-b3bd-f1fb4cfc7730 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:27.251785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931e4dc-3924-4fd7-b3bd-f1fb4cfc7730 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:27.251877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931e4dc-3924-4fd7-b3bd-f1fb4cfc7730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:27.268719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c931e4dc-3924-4fd7-b3bd-f1fb4cfc7730 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:27.269932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c931e4dc-3924-4fd7-b3bd-f1fb4cfc7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:27.336898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 554/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:27.361309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdd075-0477-4f7d-a528-185b8a8b30dd None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:27.459946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdd075-0477-4f7d-a528-185b8a8b30dd None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:27.493526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb19f3-459b-41ae-a721-b7aab215cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:27.494374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb19f3-459b-41ae-a721-b7aab215cc1f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:27.494601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb19f3-459b-41ae-a721-b7aab215cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:27.494874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb19f3-459b-41ae-a721-b7aab215cc1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:27.496045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb19f3-459b-41ae-a721-b7aab215cc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:27.497530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb19f3-459b-41ae-a721-b7aab215cc1f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:27.499148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 579/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:27.505162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931e4dc-3924-4fd7-b3bd-f1fb4cfc7730 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:27.588451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:27.608397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931e4dc-3924-4fd7-b3bd-f1fb4cfc7730 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:27.646534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec434788-f933-4c4b-a375-0b93827d2e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:27.647192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434788-f933-4c4b-a375-0b93827d2e1c None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:27.647471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434788-f933-4c4b-a375-0b93827d2e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:27.647744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434788-f933-4c4b-a375-0b93827d2e1c None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:27.648494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434788-f933-4c4b-a375-0b93827d2e1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:27.649926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434788-f933-4c4b-a375-0b93827d2e1c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:27.675806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 555/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:05:27 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:29.746644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630decab-db89-4d05-ae11-3ef1af8f7661 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:29.747220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630decab-db89-4d05-ae11-3ef1af8f7661 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:29.747220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630decab-db89-4d05-ae11-3ef1af8f7661 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:29.748676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 580/1135] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:29.754283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43755-df58-4b68-a760-49fb8fe0457d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:29.754671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43755-df58-4b68-a760-49fb8fe0457d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:29.754849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d43755-df58-4b68-a760-49fb8fe0457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:29.771549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d0d43755-df58-4b68-a760-49fb8fe0457d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:29.772780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d0d43755-df58-4b68-a760-49fb8fe0457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:29.845807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 556/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:29.870560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630decab-db89-4d05-ae11-3ef1af8f7661 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:29.933001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:29.973672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630decab-db89-4d05-ae11-3ef1af8f7661 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:30.004957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40734bc-e046-4b3f-9604-94538a31a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:30.005738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40734bc-e046-4b3f-9604-94538a31a332 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:30.006011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40734bc-e046-4b3f-9604-94538a31a332 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:30.006281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40734bc-e046-4b3f-9604-94538a31a332 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:30.007439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40734bc-e046-4b3f-9604-94538a31a332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:30.008887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40734bc-e046-4b3f-9604-94538a31a332 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:30.010492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 581/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:05:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:30.016805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43755-df58-4b68-a760-49fb8fe0457d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:30.075502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:30.112891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d43755-df58-4b68-a760-49fb8fe0457d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:30.145711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350abef-7997-44ac-9ce5-17702484a0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:30.146373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350abef-7997-44ac-9ce5-17702484a0de None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:30.146661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350abef-7997-44ac-9ce5-17702484a0de None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:30.146935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350abef-7997-44ac-9ce5-17702484a0de None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:30.147637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350abef-7997-44ac-9ce5-17702484a0de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:30.149091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350abef-7997-44ac-9ce5-17702484a0de None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:30.167960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 557/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:05:30 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:32.251020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966186f-d00f-4869-ba11-19ea17582eff None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:32.251591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966186f-d00f-4869-ba11-19ea17582eff None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:32.251591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966186f-d00f-4869-ba11-19ea17582eff None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:32.252950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 582/1139] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:32.258307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ad0e7-bd37-4be9-b545-270d857fd5df None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:32.258688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ad0e7-bd37-4be9-b545-270d857fd5df None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:32.258882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ad0e7-bd37-4be9-b545-270d857fd5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:32.275249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-303ad0e7-bd37-4be9-b545-270d857fd5df None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:32.276490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-303ad0e7-bd37-4be9-b545-270d857fd5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:32.343042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 558/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:32.367467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966186f-d00f-4869-ba11-19ea17582eff None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:32.464450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966186f-d00f-4869-ba11-19ea17582eff None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:32.492666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:32.499401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b07751-2fdf-47a2-95cb-b4af15ad7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:32.500211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b07751-2fdf-47a2-95cb-b4af15ad7470 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:32.500492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b07751-2fdf-47a2-95cb-b4af15ad7470 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:32.500763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b07751-2fdf-47a2-95cb-b4af15ad7470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:32.510899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b07751-2fdf-47a2-95cb-b4af15ad7470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-01b07751-2fdf-47a2-95cb-b4af15ad7470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:32.518493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:32.519749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:32.521085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 583/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:32.525711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ad0e7-bd37-4be9-b545-270d857fd5df None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:32.582603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:32.633217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ad0e7-bd37-4be9-b545-270d857fd5df None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:32.668033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:32.668739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:32.669021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:32.669295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:32.670049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:32.670359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:32.671736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:32.680058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 559/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:32.686079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b07751-2fdf-47a2-95cb-b4af15ad7470 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:32.788180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b07751-2fdf-47a2-95cb-b4af15ad7470 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:32.821461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46bd9e-bd65-40e5-8835-4a057b586951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:32.822348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46bd9e-bd65-40e5-8835-4a057b586951 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:32.822635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46bd9e-bd65-40e5-8835-4a057b586951 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:32.822913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46bd9e-bd65-40e5-8835-4a057b586951 None admin] PATH_INFO: `/v3/users/7a2866e2326b4dd88bde380814b8fe20` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:32.836639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46bd9e-bd65-40e5-8835-4a057b586951 None admin] RBAC: Authorizing `identity:get_user(user_id=7a2866e2326b4dd88bde380814b8fe20)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:32.838095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46bd9e-bd65-40e5-8835-4a057b586951 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:32.839778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 584/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:32 2022] GET /identity/v3/users/7a2866e2326b4dd88bde380814b8fe20 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:32.846151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:32.943631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e45864-57d3-4c6b-8911-e683a8d31baa None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:32.954121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:32.977278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edf3be-97f9-4e71-a0cf-d2915f983cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:32.977931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edf3be-97f9-4e71-a0cf-d2915f983cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:32.978213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edf3be-97f9-4e71-a0cf-d2915f983cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:32.978485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edf3be-97f9-4e71-a0cf-d2915f983cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:33.044912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edf3be-97f9-4e71-a0cf-d2915f983cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:33.046284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edf3be-97f9-4e71-a0cf-d2915f983cb7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:33.157286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 560/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:33.163624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46bd9e-bd65-40e5-8835-4a057b586951 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:33.216828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:33.269860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46bd9e-bd65-40e5-8835-4a057b586951 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:33.304991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62d1ca-9bda-48fa-8d20-a607e4b1a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:33.305774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62d1ca-9bda-48fa-8d20-a607e4b1a86c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:33.306058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62d1ca-9bda-48fa-8d20-a607e4b1a86c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:33.306333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62d1ca-9bda-48fa-8d20-a607e4b1a86c None admin] PATH_INFO: `/v3/projects/a268aab70590492cbb0909f0a3554d41` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:33.307530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62d1ca-9bda-48fa-8d20-a607e4b1a86c None admin] RBAC: Authorizing `identity:get_project(project_id=a268aab70590492cbb0909f0a3554d41)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:33.309514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62d1ca-9bda-48fa-8d20-a607e4b1a86c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:33.311220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 585/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:33 2022] GET /identity/v3/projects/a268aab70590492cbb0909f0a3554d41 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:33.317599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edf3be-97f9-4e71-a0cf-d2915f983cb7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:33.329713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:33.418762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edf3be-97f9-4e71-a0cf-d2915f983cb7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:33.452365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3bba9-3e46-424a-8202-3a4c0bbff0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:33.453016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3bba9-3e46-424a-8202-3a4c0bbff0df None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:33.453294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3bba9-3e46-424a-8202-3a4c0bbff0df None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:33.453566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3bba9-3e46-424a-8202-3a4c0bbff0df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:33.454382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3bba9-3e46-424a-8202-3a4c0bbff0df None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=a268aab70590492cbb0909f0a3554d41, user.id=7a2866e2326b4dd88bde380814b8fe20) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:33.454687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3bba9-3e46-424a-8202-3a4c0bbff0df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:33.456139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3bba9-3e46-424a-8202-3a4c0bbff0df None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:33.461894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 561/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:33 2022] GET /identity/v3/role_assignments?user.id=7a2866e2326b4dd88bde380814b8fe20&scope.project.id=a268aab70590492cbb0909f0a3554d41&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:35.467188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90218-765d-4ed4-9620-39412cfc0b2a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:35.467723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90218-765d-4ed4-9620-39412cfc0b2a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:35.467723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90218-765d-4ed4-9620-39412cfc0b2a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:35.469105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 586/1147] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:35.474466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82733-84ca-44ef-acbb-26048f0ea08a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:35.474922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82733-84ca-44ef-acbb-26048f0ea08a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:35.475015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f82733-84ca-44ef-acbb-26048f0ea08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:35.492671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-42f82733-84ca-44ef-acbb-26048f0ea08a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:35.493869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-42f82733-84ca-44ef-acbb-26048f0ea08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:35.564820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 562/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:35.588294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e90218-765d-4ed4-9620-39412cfc0b2a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:35.710437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e90218-765d-4ed4-9620-39412cfc0b2a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:35.728811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:35.747757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913b45f-532b-4fe3-8f4f-e523734a7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:35.748597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913b45f-532b-4fe3-8f4f-e523734a7401 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:35.748883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913b45f-532b-4fe3-8f4f-e523734a7401 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:35.749158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913b45f-532b-4fe3-8f4f-e523734a7401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:35.759651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913b45f-532b-4fe3-8f4f-e523734a7401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2913b45f-532b-4fe3-8f4f-e523734a7401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:35.767856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:35.768881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:35.769747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 587/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:35.775414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f82733-84ca-44ef-acbb-26048f0ea08a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:35.779202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:35.873294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f82733-84ca-44ef-acbb-26048f0ea08a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:35.907063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:35.907723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:35.908004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:35.908311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:35.909061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:35.909368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:35.910734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:35.918677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 563/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:35.925724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913b45f-532b-4fe3-8f4f-e523734a7401 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:36.021361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913b45f-532b-4fe3-8f4f-e523734a7401 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:36.053221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51e1f5-bb57-410e-9354-c0976e0c51a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:36.054086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e1f5-bb57-410e-9354-c0976e0c51a9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:36.054368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e1f5-bb57-410e-9354-c0976e0c51a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:36.054641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e1f5-bb57-410e-9354-c0976e0c51a9 None admin] PATH_INFO: `/v3/users/7a2866e2326b4dd88bde380814b8fe20` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:36.055821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51e1f5-bb57-410e-9354-c0976e0c51a9 None admin] RBAC: Authorizing `identity:get_user(user_id=7a2866e2326b4dd88bde380814b8fe20)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:36.057282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51e1f5-bb57-410e-9354-c0976e0c51a9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:36.059442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 588/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:35 2022] GET /identity/v3/users/7a2866e2326b4dd88bde380814b8fe20 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:36.065364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:36.128444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:36.162200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0e017-8b8e-464a-8da3-7ba3917be679 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:36.194277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec091b6-5399-49cd-ad3b-014ad41584cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:36.195125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec091b6-5399-49cd-ad3b-014ad41584cc None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:36.195409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec091b6-5399-49cd-ad3b-014ad41584cc None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:36.195685 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec091b6-5399-49cd-ad3b-014ad41584cc None admin] PATH_INFO: `/v3/projects/a268aab70590492cbb0909f0a3554d41` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:36.206177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec091b6-5399-49cd-ad3b-014ad41584cc None admin] RBAC: Authorizing `identity:get_project(project_id=a268aab70590492cbb0909f0a3554d41)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:36.207644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec091b6-5399-49cd-ad3b-014ad41584cc None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:36.209438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 564/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:36 2022] GET /identity/v3/projects/a268aab70590492cbb0909f0a3554d41 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:36.215539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51e1f5-bb57-410e-9354-c0976e0c51a9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:36.259343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:36.311364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51e1f5-bb57-410e-9354-c0976e0c51a9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:36.346098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b28578-1abe-445f-8116-f820fbd2396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:36.346991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28578-1abe-445f-8116-f820fbd2396b None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:36.347276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28578-1abe-445f-8116-f820fbd2396b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:36.347552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b28578-1abe-445f-8116-f820fbd2396b None admin] PATH_INFO: `/v3/projects/a268aab70590492cbb0909f0a3554d41/users/7a2866e2326b4dd88bde380814b8fe20/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:36.349529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b28578-1abe-445f-8116-f820fbd2396b None admin] RBAC: Authorizing `identity:create_grant(project_id=a268aab70590492cbb0909f0a3554d41, user_id=7a2866e2326b4dd88bde380814b8fe20, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:36.350971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b28578-1abe-445f-8116-f820fbd2396b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:36.363649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 589/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:05:36 2022] PUT /identity/v3/projects/a268aab70590492cbb0909f0a3554d41/users/7a2866e2326b4dd88bde380814b8fe20/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:38.387913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78c24c-1e39-4660-a381-e6871d024ed4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:38.388509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78c24c-1e39-4660-a381-e6871d024ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:38.388509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78c24c-1e39-4660-a381-e6871d024ed4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:38.389866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 565/1154] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:38.395057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994654-1dda-4390-8438-14d322836191 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:38.395447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994654-1dda-4390-8438-14d322836191 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:38.395607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994654-1dda-4390-8438-14d322836191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:38.412227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b4994654-1dda-4390-8438-14d322836191 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:38.413432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b4994654-1dda-4390-8438-14d322836191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:38.476894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 590/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:38.500949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78c24c-1e39-4660-a381-e6871d024ed4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:38.600628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78c24c-1e39-4660-a381-e6871d024ed4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:38.643218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f514bf-1545-4124-b43f-9ecda8821ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:38.643861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f514bf-1545-4124-b43f-9ecda8821ecd None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:38.644172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f514bf-1545-4124-b43f-9ecda8821ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:38.644446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f514bf-1545-4124-b43f-9ecda8821ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:38.646535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:38.656473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f514bf-1545-4124-b43f-9ecda8821ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-91f514bf-1545-4124-b43f-9ecda8821ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:38.663917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:38.665062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:38.666174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 566/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:38.671836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4994654-1dda-4390-8438-14d322836191 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:38.704950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:38.770189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4994654-1dda-4390-8438-14d322836191 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:38.803103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:38.803762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:38.804049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:38.804358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:38.805109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:38.805417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:38.806820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:38.815147 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 591/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:38.821177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f514bf-1545-4124-b43f-9ecda8821ecd None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:38.922455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f514bf-1545-4124-b43f-9ecda8821ecd None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:38.958711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12bbb-355d-4ea3-b8ee-d7349b22ec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:38.959577 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12bbb-355d-4ea3-b8ee-d7349b22ec0a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:38.959860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12bbb-355d-4ea3-b8ee-d7349b22ec0a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:38.960152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12bbb-355d-4ea3-b8ee-d7349b22ec0a None admin] PATH_INFO: `/v3/users/7a2866e2326b4dd88bde380814b8fe20` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:38.961329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12bbb-355d-4ea3-b8ee-d7349b22ec0a None admin] RBAC: Authorizing `identity:get_user(user_id=7a2866e2326b4dd88bde380814b8fe20)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:38.962754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12bbb-355d-4ea3-b8ee-d7349b22ec0a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:38.964417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 567/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:38 2022] GET /identity/v3/users/7a2866e2326b4dd88bde380814b8fe20 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:38.970355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:39.061725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:39.067937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e511e-e2ac-4561-9757-828e8b5b6a7c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:39.100415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152293b4-04c8-42b0-972c-eae40ac929ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:39.101047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152293b4-04c8-42b0-972c-eae40ac929ac None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:39.101327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152293b4-04c8-42b0-972c-eae40ac929ac None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:39.101649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152293b4-04c8-42b0-972c-eae40ac929ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:39.166437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152293b4-04c8-42b0-972c-eae40ac929ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:39.168527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152293b4-04c8-42b0-972c-eae40ac929ac None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:39.257237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:39.263924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 592/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:39.270062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12bbb-355d-4ea3-b8ee-d7349b22ec0a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:39.336868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:39.375406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12bbb-355d-4ea3-b8ee-d7349b22ec0a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:39.408600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad779b5-b5c0-4a47-857f-da3700e49208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:39.409450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad779b5-b5c0-4a47-857f-da3700e49208 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:39.409734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad779b5-b5c0-4a47-857f-da3700e49208 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:39.410010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad779b5-b5c0-4a47-857f-da3700e49208 None admin] PATH_INFO: `/v3/projects/a268aab70590492cbb0909f0a3554d41` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:39.411186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad779b5-b5c0-4a47-857f-da3700e49208 None admin] RBAC: Authorizing `identity:get_project(project_id=a268aab70590492cbb0909f0a3554d41)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:39.412660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad779b5-b5c0-4a47-857f-da3700e49208 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:39.414355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 568/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:39 2022] GET /identity/v3/projects/a268aab70590492cbb0909f0a3554d41 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:39.420531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152293b4-04c8-42b0-972c-eae40ac929ac None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:39.517616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152293b4-04c8-42b0-972c-eae40ac929ac None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:39.551228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d780c4c-62e9-464d-81dc-ac7826d8c58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:39.551872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c4c-62e9-464d-81dc-ac7826d8c58c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:39.552183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c4c-62e9-464d-81dc-ac7826d8c58c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:39.552458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d780c4c-62e9-464d-81dc-ac7826d8c58c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:39.553281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d780c4c-62e9-464d-81dc-ac7826d8c58c None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=a268aab70590492cbb0909f0a3554d41, user.id=7a2866e2326b4dd88bde380814b8fe20) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:39.553588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d780c4c-62e9-464d-81dc-ac7826d8c58c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:39.555012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d780c4c-62e9-464d-81dc-ac7826d8c58c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:39.560974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 593/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:39 2022] GET /identity/v3/role_assignments?user.id=7a2866e2326b4dd88bde380814b8fe20&scope.project.id=a268aab70590492cbb0909f0a3554d41&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:41.622260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc8eb1-5ea3-444b-a858-d8b942fa796a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:41.622770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc8eb1-5ea3-444b-a858-d8b942fa796a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:41.622863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc8eb1-5ea3-444b-a858-d8b942fa796a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:41.624207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 569/1162] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:41.629562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68057-30f9-4136-a853-ce04779e8036 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:41.629974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68057-30f9-4136-a853-ce04779e8036 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:41.630110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f68057-30f9-4136-a853-ce04779e8036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:41.646851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-72f68057-30f9-4136-a853-ce04779e8036 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:41.648024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-72f68057-30f9-4136-a853-ce04779e8036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:41.701896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:41.713268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 594/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:41.736043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc8eb1-5ea3-444b-a858-d8b942fa796a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:41.840739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc8eb1-5ea3-444b-a858-d8b942fa796a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:41.868083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:41.874851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6f37-0d3a-49a9-8807-03a4aec00357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:41.875497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6f37-0d3a-49a9-8807-03a4aec00357 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:41.875776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6f37-0d3a-49a9-8807-03a4aec00357 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:41.876051 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f6f37-0d3a-49a9-8807-03a4aec00357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:41.947506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6f37-0d3a-49a9-8807-03a4aec00357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:41.949275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f6f37-0d3a-49a9-8807-03a4aec00357 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:42.045489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 570/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:42.051417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f68057-30f9-4136-a853-ce04779e8036 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:42.144071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f68057-30f9-4136-a853-ce04779e8036 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:42.176774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10aa8b-9555-47f4-a560-4dac156db9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:42.177567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10aa8b-9555-47f4-a560-4dac156db9ad None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:42.177851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10aa8b-9555-47f4-a560-4dac156db9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:42.178123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10aa8b-9555-47f4-a560-4dac156db9ad None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:42.184527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10aa8b-9555-47f4-a560-4dac156db9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:42.186018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10aa8b-9555-47f4-a560-4dac156db9ad None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3d10aa8b-9555-47f4-a560-4dac156db9ad None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:42.200013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:42.201224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:42.202108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 595/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:05:42 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:42.207395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6f37-0d3a-49a9-8807-03a4aec00357 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:42.237330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:42.303372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f6f37-0d3a-49a9-8807-03a4aec00357 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:42.336262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce439db-ee9b-49d1-96f8-c36b8089aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:42.336901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce439db-ee9b-49d1-96f8-c36b8089aae9 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:42.337187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce439db-ee9b-49d1-96f8-c36b8089aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:42.337456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce439db-ee9b-49d1-96f8-c36b8089aae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:42.338165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce439db-ee9b-49d1-96f8-c36b8089aae9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:42.338464 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce439db-ee9b-49d1-96f8-c36b8089aae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:42.340346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce439db-ee9b-49d1-96f8-c36b8089aae9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:42.347171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 571/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Thu Jul 14 11:05:42 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:44.373191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61671d-fedc-405d-a2c0-e3d102a0e08b None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:44.373739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61671d-fedc-405d-a2c0-e3d102a0e08b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:44.373739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61671d-fedc-405d-a2c0-e3d102a0e08b None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:44.375097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 596/1167] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:44.380210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096480d-a135-484b-b5d9-f8a7fb06838c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:44.380628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096480d-a135-484b-b5d9-f8a7fb06838c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:44.380768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096480d-a135-484b-b5d9-f8a7fb06838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:44.397199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b096480d-a135-484b-b5d9-f8a7fb06838c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:44.398371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b096480d-a135-484b-b5d9-f8a7fb06838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:44.461461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 572/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:44.485171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61671d-fedc-405d-a2c0-e3d102a0e08b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:44.539624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:44.589889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61671d-fedc-405d-a2c0-e3d102a0e08b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:44.622801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75b8e4-81b7-4667-bf9f-3714093deacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:44.623557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75b8e4-81b7-4667-bf9f-3714093deacf None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:44.623732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75b8e4-81b7-4667-bf9f-3714093deacf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:44.624004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75b8e4-81b7-4667-bf9f-3714093deacf None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:44.624899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75b8e4-81b7-4667-bf9f-3714093deacf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:44.626280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75b8e4-81b7-4667-bf9f-3714093deacf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:44.643164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 597/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Thu Jul 14 11:05:44 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:46.689793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e098-4cfb-46de-b5ce-b045f6055636 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:46.690406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e098-4cfb-46de-b5ce-b045f6055636 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:46.690406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560e098-4cfb-46de-b5ce-b045f6055636 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:46.691711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 573/1170] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:46.697034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514deff-bd20-40d9-a7d0-c89404b1b807 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:46.697432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514deff-bd20-40d9-a7d0-c89404b1b807 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:46.697583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514deff-bd20-40d9-a7d0-c89404b1b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:46.714160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a514deff-bd20-40d9-a7d0-c89404b1b807 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:46.715373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a514deff-bd20-40d9-a7d0-c89404b1b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:46.777831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 598/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:46.800666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560e098-4cfb-46de-b5ce-b045f6055636 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:46.826260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:46.902360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560e098-4cfb-46de-b5ce-b045f6055636 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:46.937225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd61007-e972-45f8-aabe-85bdea1594c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:46.938080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61007-e972-45f8-aabe-85bdea1594c2 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:46.938362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61007-e972-45f8-aabe-85bdea1594c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:46.938637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd61007-e972-45f8-aabe-85bdea1594c2 None admin] PATH_INFO: `/v3/domains/46d97e642c0c46c0a8fb62789fcd15b8` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:46.949155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd61007-e972-45f8-aabe-85bdea1594c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=46d97e642c0c46c0a8fb62789fcd15b8)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:46.950590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd61007-e972-45f8-aabe-85bdea1594c2 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:46.952248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 574/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Thu Jul 14 11:05:46 2022] GET /identity/v3/domains/46d97e642c0c46c0a8fb62789fcd15b8 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:46.958164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514deff-bd20-40d9-a7d0-c89404b1b807 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:46.998367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:47.054325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514deff-bd20-40d9-a7d0-c89404b1b807 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:47.086955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748d22f-0e90-4794-9f1e-0e8760745e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:47.087610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748d22f-0e90-4794-9f1e-0e8760745e25 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:47.087896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748d22f-0e90-4794-9f1e-0e8760745e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:47.088245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748d22f-0e90-4794-9f1e-0e8760745e25 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:47.088915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748d22f-0e90-4794-9f1e-0e8760745e25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:47.090380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748d22f-0e90-4794-9f1e-0e8760745e25 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:47.114746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 599/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:05:46 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:49.152782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2cc46-269c-4464-a793-bb72bb14ce7e None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.153323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2cc46-269c-4464-a793-bb72bb14ce7e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.153323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2cc46-269c-4464-a793-bb72bb14ce7e None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.154685 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 575/1174] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:49.159720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295561d-5d87-4841-b3e5-dc276a7e458c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.160168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295561d-5d87-4841-b3e5-dc276a7e458c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.160312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295561d-5d87-4841-b3e5-dc276a7e458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.176511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4295561d-5d87-4841-b3e5-dc276a7e458c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:49.177704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4295561d-5d87-4841-b3e5-dc276a7e458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:49.242327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 600/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:49.267088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2cc46-269c-4464-a793-bb72bb14ce7e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:49.349272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:49.366144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2cc46-269c-4464-a793-bb72bb14ce7e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:49.398873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb496c-18bf-43c8-9ac7-a9eec64e5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:49.399729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb496c-18bf-43c8-9ac7-a9eec64e5669 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.400007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb496c-18bf-43c8-9ac7-a9eec64e5669 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.400307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb496c-18bf-43c8-9ac7-a9eec64e5669 None admin] PATH_INFO: `/v3/domains/46d97e642c0c46c0a8fb62789fcd15b8` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.401482 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb496c-18bf-43c8-9ac7-a9eec64e5669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=46d97e642c0c46c0a8fb62789fcd15b8)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:49.403572 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb496c-18bf-43c8-9ac7-a9eec64e5669 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:49.405165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 576/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Thu Jul 14 11:05:49 2022] GET /identity/v3/domains/46d97e642c0c46c0a8fb62789fcd15b8 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:49.410998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295561d-5d87-4841-b3e5-dc276a7e458c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:49.433905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:49.506709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295561d-5d87-4841-b3e5-dc276a7e458c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:49.540826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59162242-fcd6-4bfc-97f0-ede5a0743c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:49.541495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162242-fcd6-4bfc-97f0-ede5a0743c3b None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:49.541835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162242-fcd6-4bfc-97f0-ede5a0743c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:49.542109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162242-fcd6-4bfc-97f0-ede5a0743c3b None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:49.542996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59162242-fcd6-4bfc-97f0-ede5a0743c3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:49.544455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59162242-fcd6-4bfc-97f0-ede5a0743c3b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:49.564833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 601/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:05:49 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:05:51.643198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efa608-26dd-45ab-ac4f-3db8d919960a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:51.643739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efa608-26dd-45ab-ac4f-3db8d919960a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:51.643739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efa608-26dd-45ab-ac4f-3db8d919960a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:51.645129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 577/1178] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:05:51.650316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883d753-e623-44d6-9dff-c9a1f7c389e4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:51.650706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883d753-e623-44d6-9dff-c9a1f7c389e4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:51.650880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883d753-e623-44d6-9dff-c9a1f7c389e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:51.667213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d883d753-e623-44d6-9dff-c9a1f7c389e4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:51.669016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d883d753-e623-44d6-9dff-c9a1f7c389e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:51.732652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 602/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:51.756462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efa608-26dd-45ab-ac4f-3db8d919960a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:51.856770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efa608-26dd-45ab-ac4f-3db8d919960a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:51.889696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef898-ed7e-4773-818d-a1e8e03ba864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:51.890478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef898-ed7e-4773-818d-a1e8e03ba864 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:51.890757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef898-ed7e-4773-818d-a1e8e03ba864 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:51.891029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ef898-ed7e-4773-818d-a1e8e03ba864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:51.900645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ef898-ed7e-4773-818d-a1e8e03ba864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b31ef898-ed7e-4773-818d-a1e8e03ba864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:51.908719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:51.909916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:51.910995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 578/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:51.915919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883d753-e623-44d6-9dff-c9a1f7c389e4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:51.926342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:52.010805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883d753-e623-44d6-9dff-c9a1f7c389e4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.043899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.044582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.044864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.045137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.045885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:52.046186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.047580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.055302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 603/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:52.061039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef898-ed7e-4773-818d-a1e8e03ba864 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.076276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:52.158555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ef898-ed7e-4773-818d-a1e8e03ba864 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.190534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4bb54-6d32-4831-b42e-ce3bfecde172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.191407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4bb54-6d32-4831-b42e-ce3bfecde172 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.191696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4bb54-6d32-4831-b42e-ce3bfecde172 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.191963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4bb54-6d32-4831-b42e-ce3bfecde172 None admin] PATH_INFO: `/v3/users/c16174619bc342d1b0c7f0ee765232f1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.213802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4bb54-6d32-4831-b42e-ce3bfecde172 None admin] RBAC: Authorizing `identity:get_user(user_id=c16174619bc342d1b0c7f0ee765232f1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.215962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae4bb54-6d32-4831-b42e-ce3bfecde172 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.217722 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 579/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:52 2022] GET /identity/v3/users/c16174619bc342d1b0c7f0ee765232f1 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:52.223476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.289429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:52.319437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3d14c-d434-4b96-b56e-b3beebd4b327 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.351627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97d58-958f-463c-9c86-2c3100379bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.352297 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97d58-958f-463c-9c86-2c3100379bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.352585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97d58-958f-463c-9c86-2c3100379bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.352863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97d58-958f-463c-9c86-2c3100379bb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.424563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da97d58-958f-463c-9c86-2c3100379bb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.425958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da97d58-958f-463c-9c86-2c3100379bb6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.491132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:52.521708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 604/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:52.528125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4bb54-6d32-4831-b42e-ce3bfecde172 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.594272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:52.623943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4bb54-6d32-4831-b42e-ce3bfecde172 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.656653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524da087-e617-4fdf-8ed6-82240aa06c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.657508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da087-e617-4fdf-8ed6-82240aa06c99 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.657790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da087-e617-4fdf-8ed6-82240aa06c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.658062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524da087-e617-4fdf-8ed6-82240aa06c99 None admin] PATH_INFO: `/v3/projects/b7d8899ed5ec4a179495efd9248a7e27` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.659225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524da087-e617-4fdf-8ed6-82240aa06c99 None admin] RBAC: Authorizing `identity:get_project(project_id=b7d8899ed5ec4a179495efd9248a7e27)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.660703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524da087-e617-4fdf-8ed6-82240aa06c99 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.662390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 580/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:52 2022] GET /identity/v3/projects/b7d8899ed5ec4a179495efd9248a7e27 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:52.668582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97d58-958f-463c-9c86-2c3100379bb6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:52.769805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97d58-958f-463c-9c86-2c3100379bb6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:52.801535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fac64-99c9-417a-aeeb-4f14250f8a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:52.802188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fac64-99c9-417a-aeeb-4f14250f8a89 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:52.802474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fac64-99c9-417a-aeeb-4f14250f8a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:52.802752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fac64-99c9-417a-aeeb-4f14250f8a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:52.803576 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fac64-99c9-417a-aeeb-4f14250f8a89 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=b7d8899ed5ec4a179495efd9248a7e27, user.id=c16174619bc342d1b0c7f0ee765232f1) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:52.803888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fac64-99c9-417a-aeeb-4f14250f8a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:52.805359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fac64-99c9-417a-aeeb-4f14250f8a89 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:52.811138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 605/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:52 2022] GET /identity/v3/role_assignments?user.id=c16174619bc342d1b0c7f0ee765232f1&scope.project.id=b7d8899ed5ec4a179495efd9248a7e27&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:54.808952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f313-ebd6-473b-9ca2-855c4db5236a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:54.809476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f313-ebd6-473b-9ca2-855c4db5236a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:54.809476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6f313-ebd6-473b-9ca2-855c4db5236a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:54.810803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 581/1186] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:54.815894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735f0c-ba82-4c51-9c24-77945176b105 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:54.816336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735f0c-ba82-4c51-9c24-77945176b105 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:54.816482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735f0c-ba82-4c51-9c24-77945176b105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:54.833337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-33735f0c-ba82-4c51-9c24-77945176b105 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:54.834497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-33735f0c-ba82-4c51-9c24-77945176b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:54.860902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:54.900295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 606/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:05:54.923977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6f313-ebd6-473b-9ca2-855c4db5236a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.020737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6f313-ebd6-473b-9ca2-855c4db5236a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.055072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c408e-b9a1-4578-a535-6d83f74f5b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.055861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c408e-b9a1-4578-a535-6d83f74f5b86 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.056164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c408e-b9a1-4578-a535-6d83f74f5b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.056435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c408e-b9a1-4578-a535-6d83f74f5b86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.063276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:55.067472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c408e-b9a1-4578-a535-6d83f74f5b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-565c408e-b9a1-4578-a535-6d83f74f5b86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:55.075379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:55.076510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:05:55.077550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 582/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:55.082847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735f0c-ba82-4c51-9c24-77945176b105 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.189644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735f0c-ba82-4c51-9c24-77945176b105 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.232291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.232948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.233232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.233506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.234253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:55.234560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.235945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.243720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 607/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:55.249616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c408e-b9a1-4578-a535-6d83f74f5b86 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.346551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c408e-b9a1-4578-a535-6d83f74f5b86 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.379340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f625a8-dfb7-46a6-962e-e8ab10aa761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.380231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f625a8-dfb7-46a6-962e-e8ab10aa761b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.380511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f625a8-dfb7-46a6-962e-e8ab10aa761b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.380782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f625a8-dfb7-46a6-962e-e8ab10aa761b None admin] PATH_INFO: `/v3/users/c16174619bc342d1b0c7f0ee765232f1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.381957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f625a8-dfb7-46a6-962e-e8ab10aa761b None admin] RBAC: Authorizing `identity:get_user(user_id=c16174619bc342d1b0c7f0ee765232f1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.383392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f625a8-dfb7-46a6-962e-e8ab10aa761b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.385067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 583/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:55 2022] GET /identity/v3/users/c16174619bc342d1b0c7f0ee765232f1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:55.390889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.419570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:55.490598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f9c2e4-ac22-4c8d-a004-17dcce50bdee None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.523098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574574-649a-40d9-a5db-c17693b2c2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.523960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574574-649a-40d9-a5db-c17693b2c2cc None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.524277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574574-649a-40d9-a5db-c17693b2c2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.524555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574574-649a-40d9-a5db-c17693b2c2cc None admin] PATH_INFO: `/v3/projects/b7d8899ed5ec4a179495efd9248a7e27` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.525724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83574574-649a-40d9-a5db-c17693b2c2cc None admin] RBAC: Authorizing `identity:get_project(project_id=b7d8899ed5ec4a179495efd9248a7e27)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.527823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83574574-649a-40d9-a5db-c17693b2c2cc None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.529567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 608/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:55 2022] GET /identity/v3/projects/b7d8899ed5ec4a179495efd9248a7e27 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:55.535414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f625a8-dfb7-46a6-962e-e8ab10aa761b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:55.599535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:55.633548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f625a8-dfb7-46a6-962e-e8ab10aa761b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:55.665625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68450982-9002-4ff6-a0f9-b512426632b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:55.666484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68450982-9002-4ff6-a0f9-b512426632b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:55.666768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68450982-9002-4ff6-a0f9-b512426632b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:55.667042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68450982-9002-4ff6-a0f9-b512426632b7 None admin] PATH_INFO: `/v3/projects/b7d8899ed5ec4a179495efd9248a7e27/users/c16174619bc342d1b0c7f0ee765232f1/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:55.669638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68450982-9002-4ff6-a0f9-b512426632b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7d8899ed5ec4a179495efd9248a7e27, user_id=c16174619bc342d1b0c7f0ee765232f1, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:55.671068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68450982-9002-4ff6-a0f9-b512426632b7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:55.683348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 584/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:05:55 2022] PUT /identity/v3/projects/b7d8899ed5ec4a179495efd9248a7e27/users/c16174619bc342d1b0c7f0ee765232f1/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:05:57.751508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d86e-e1d0-4380-8cf0-91fffc610391 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.752061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d86e-e1d0-4380-8cf0-91fffc610391 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.752061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448d86e-e1d0-4380-8cf0-91fffc610391 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.753494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 609/1193] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:05:57.759991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e4a5-255e-48b5-be4c-6f96d652a27f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:57.760469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e4a5-255e-48b5-be4c-6f96d652a27f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:57.760562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954e4a5-255e-48b5-be4c-6f96d652a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:57.777728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4954e4a5-255e-48b5-be4c-6f96d652a27f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:05:57.778936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4954e4a5-255e-48b5-be4c-6f96d652a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:05:57.849151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 585/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:05:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:05:57.873394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448d86e-e1d0-4380-8cf0-91fffc610391 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:57.968818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:57.977658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448d86e-e1d0-4380-8cf0-91fffc610391 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.012091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dda8d-2c81-46ea-9891-236248f0ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.012962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dda8d-2c81-46ea-9891-236248f0ad36 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.013178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dda8d-2c81-46ea-9891-236248f0ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.013447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dda8d-2c81-46ea-9891-236248f0ad36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.023743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dda8d-2c81-46ea-9891-236248f0ad36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-663dda8d-2c81-46ea-9891-236248f0ad36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:05:58.031908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:05:58.033139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:05:58.034033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 610/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:05:58.039243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954e4a5-255e-48b5-be4c-6f96d652a27f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.099365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:58.142612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954e4a5-255e-48b5-be4c-6f96d652a27f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.177378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.178050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.178325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.178595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.179339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:58.179643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.181036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.189145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 586/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:58.195265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dda8d-2c81-46ea-9891-236248f0ad36 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.291876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dda8d-2c81-46ea-9891-236248f0ad36 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.324484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759442-ced2-4a7a-81d9-af56a8256f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.325349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759442-ced2-4a7a-81d9-af56a8256f4e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.325631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759442-ced2-4a7a-81d9-af56a8256f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.325907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a759442-ced2-4a7a-81d9-af56a8256f4e None admin] PATH_INFO: `/v3/users/c16174619bc342d1b0c7f0ee765232f1` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.327092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a759442-ced2-4a7a-81d9-af56a8256f4e None admin] RBAC: Authorizing `identity:get_user(user_id=c16174619bc342d1b0c7f0ee765232f1)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.328564 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a759442-ced2-4a7a-81d9-af56a8256f4e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.330192 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 611/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/users/c16174619bc342d1b0c7f0ee765232f1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:58.336072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.436313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943eaa4-9ecd-416c-8de5-0916ccd3e8b7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.453421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:58.470125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b850ea-e1ab-43c8-a680-d59668569059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.470772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b850ea-e1ab-43c8-a680-d59668569059 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.471057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b850ea-e1ab-43c8-a680-d59668569059 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.471335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b850ea-e1ab-43c8-a680-d59668569059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.539090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b850ea-e1ab-43c8-a680-d59668569059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.540589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b850ea-e1ab-43c8-a680-d59668569059 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.634799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 587/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:05:58.640930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759442-ced2-4a7a-81d9-af56a8256f4e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.665215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:58.740732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a759442-ced2-4a7a-81d9-af56a8256f4e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.772189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5845cc-d7a9-490a-8dc2-8e698ec89f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.773038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5845cc-d7a9-490a-8dc2-8e698ec89f76 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.773318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5845cc-d7a9-490a-8dc2-8e698ec89f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.773588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5845cc-d7a9-490a-8dc2-8e698ec89f76 None admin] PATH_INFO: `/v3/projects/b7d8899ed5ec4a179495efd9248a7e27` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.774746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5845cc-d7a9-490a-8dc2-8e698ec89f76 None admin] RBAC: Authorizing `identity:get_project(project_id=b7d8899ed5ec4a179495efd9248a7e27)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.776196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5845cc-d7a9-490a-8dc2-8e698ec89f76 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.778396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 612/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/projects/b7d8899ed5ec4a179495efd9248a7e27 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:05:58.784590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b850ea-e1ab-43c8-a680-d59668569059 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:05:58.802791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:05:58.881249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b850ea-e1ab-43c8-a680-d59668569059 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:05:58.914099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e45b76-e9e0-4cb9-b6d7-5f7cc77af572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:05:58.914739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e45b76-e9e0-4cb9-b6d7-5f7cc77af572 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:05:58.915020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e45b76-e9e0-4cb9-b6d7-5f7cc77af572 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:05:58.915293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e45b76-e9e0-4cb9-b6d7-5f7cc77af572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:05:58.916134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e45b76-e9e0-4cb9-b6d7-5f7cc77af572 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=b7d8899ed5ec4a179495efd9248a7e27, user.id=c16174619bc342d1b0c7f0ee765232f1) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:05:58.916947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e45b76-e9e0-4cb9-b6d7-5f7cc77af572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:05:58.917897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e45b76-e9e0-4cb9-b6d7-5f7cc77af572 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:05:58.923698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 588/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:05:58 2022] GET /identity/v3/role_assignments?user.id=c16174619bc342d1b0c7f0ee765232f1&scope.project.id=b7d8899ed5ec4a179495efd9248a7e27&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:06:08.768520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=55 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:08.920929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=59 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:55.647911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9abd-7fb4-45c9-a193-993fc4cfb306 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:55.648572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9abd-7fb4-45c9-a193-993fc4cfb306 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:55.648572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e9abd-7fb4-45c9-a193-993fc4cfb306 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:55.650035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 613/1201] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:06:55.656323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608080-16c6-4c4a-80e5-26afe63cfe8b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:55.656856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608080-16c6-4c4a-80e5-26afe63cfe8b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:55.656856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608080-16c6-4c4a-80e5-26afe63cfe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:55.675125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-27608080-16c6-4c4a-80e5-26afe63cfe8b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:55.676392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-27608080-16c6-4c4a-80e5-26afe63cfe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:55.767917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 589/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:06:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:06:55.793840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9abd-7fb4-45c9-a193-993fc4cfb306 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:55.927327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e9abd-7fb4-45c9-a193-993fc4cfb306 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:55.978878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:55.979866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:55.980128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:55.980503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:55.992637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:55.994282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:06:56.016670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:06:56.017773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:06:56.018780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:06:56.018780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:06:56.018780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:06:56.018780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:06:56.024145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 614/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:06:56.024487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608080-16c6-4c4a-80e5-26afe63cfe8b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:56.165251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608080-16c6-4c4a-80e5-26afe63cfe8b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:56.206785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:56.221089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222944f8-fdff-4b08-818d-b3689875ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:56.221089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222944f8-fdff-4b08-818d-b3689875ce31 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:56.221089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222944f8-fdff-4b08-818d-b3689875ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:56.221089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222944f8-fdff-4b08-818d-b3689875ce31 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:56.221562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222944f8-fdff-4b08-818d-b3689875ce31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:06:56.221562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222944f8-fdff-4b08-818d-b3689875ce31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:56.221562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222944f8-fdff-4b08-818d-b3689875ce31 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:56.235983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 590/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:06:56.246254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:56.322148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:56.380060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb8f4e-c21c-46e1-8be2-8b8da8d09f2e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:56.429156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6a8df-ae2c-4378-b209-dc1f0213ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:56.429781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a8df-ae2c-4378-b209-dc1f0213ca99 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:56.430065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a8df-ae2c-4378-b209-dc1f0213ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:56.430341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6a8df-ae2c-4378-b209-dc1f0213ca99 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:56.431058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6a8df-ae2c-4378-b209-dc1f0213ca99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:56.433107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6a8df-ae2c-4378-b209-dc1f0213ca99 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:56.476141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 615/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Thu Jul 14 11:06:56 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:06:58.736272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe32f7-66de-4860-9d5b-fb6b278195b3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:58.736835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe32f7-66de-4860-9d5b-fb6b278195b3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:58.737271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe32f7-66de-4860-9d5b-fb6b278195b3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:58.739773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 591/1206] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:06:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:06:58.747955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02fb44-e86a-48fe-91fb-7bb0e9f0992c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:58.748677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02fb44-e86a-48fe-91fb-7bb0e9f0992c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:58.749098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02fb44-e86a-48fe-91fb-7bb0e9f0992c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:58.769452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9a02fb44-e86a-48fe-91fb-7bb0e9f0992c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:06:58.770694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9a02fb44-e86a-48fe-91fb-7bb0e9f0992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:06:58.859050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 616/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:06:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:06:58.886637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe32f7-66de-4860-9d5b-fb6b278195b3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:59.039106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe32f7-66de-4860-9d5b-fb6b278195b3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:59.092791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0738e44-1b8d-4690-a58c-d822305d466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:59.098190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738e44-1b8d-4690-a58c-d822305d466c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:59.098190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738e44-1b8d-4690-a58c-d822305d466c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:59.098190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738e44-1b8d-4690-a58c-d822305d466c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:59.110634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0738e44-1b8d-4690-a58c-d822305d466c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-a0738e44-1b8d-4690-a58c-d822305d466c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:06:59.124199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:06:59.125458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:06:59.126354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:06:59.128703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 592/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:06:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:06:59.135588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02fb44-e86a-48fe-91fb-7bb0e9f0992c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:59.186255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:59.265204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02fb44-e86a-48fe-91fb-7bb0e9f0992c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:59.303319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:59.303996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:59.304299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:59.304575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:59.305393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:06:59.305691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:59.307253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:59.316314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 617/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:06:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:06:59.322419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0738e44-1b8d-4690-a58c-d822305d466c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:59.387017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:59.454455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0738e44-1b8d-4690-a58c-d822305d466c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:59.496199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:59.497017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:59.497323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:59.497561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:59.510997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:59.512551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:06:59.532738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:06:59.534431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:06:59.536044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:06:59.536044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:06:59.536044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:06:59.536044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:06:59.536044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 593/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:06:59.539816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:59.669136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:59.672467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127e34c-7734-4fef-bc31-cdb5f09a4316 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:59.715565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:59.716526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:59.716906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:59.717202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:59.718204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:06:59.718526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:59.720617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:59.744156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 618/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:06:59.744987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:06:59.864863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9a5b9-164f-414f-ad43-09f17b2700d7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:06:59.866694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:06:59.911965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:06:59.913070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:06:59.913631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:06:59.913780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:06:59.925446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:06:59.926951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:06:59.944861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:06:59.945947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:06:59.946987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:06:59.951517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 594/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:06:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:06:59.952617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:00.071667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c614e98-28bf-4327-88a4-c394da164ad3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:00.113949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:00.114933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:00.115221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:00.115529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:00.116516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:00.116834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:00.118305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:00.140024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 619/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Jul 14 11:06:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:00.145054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:00.288914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6f4ab-106e-4077-8a3a-5f7a70d89734 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:00.337987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61e2cd-3b19-4100-af97-b6702acb81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:00.339348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61e2cd-3b19-4100-af97-b6702acb81b3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:00.339656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61e2cd-3b19-4100-af97-b6702acb81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:00.340001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61e2cd-3b19-4100-af97-b6702acb81b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:00.384369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:00.429794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61e2cd-3b19-4100-af97-b6702acb81b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:00.431784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61e2cd-3b19-4100-af97-b6702acb81b3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:00.595104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 595/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:07:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:07:00.601777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:00.626325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:00.732084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed4981-57f9-42d9-af3d-fccd006a5064 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:00.779384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:00.780307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:00.780594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:00.780924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:00.795568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:00.797311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:00.817787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:00.819110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:00.820031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:00.820031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:00.820031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:00.820031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:00.820031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 620/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:00.827268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61e2cd-3b19-4100-af97-b6702acb81b3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:00.901571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:00.957619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61e2cd-3b19-4100-af97-b6702acb81b3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:01.002595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:01.003329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:01.003610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:01.003882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:01.004709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:01.005017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:01.006654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:01.021789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 596/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:01.028039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:01.113070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:01.148462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314d2f1-fa8d-4175-95da-1ec5bdf21b8d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:01.189467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:01.190199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:01.190488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:01.190773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:01.199566 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:01.201682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:07:01.223049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:01.224486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:01.230247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 621/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:07:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:01.233476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:01.356677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10043e31-0361-42b7-9f43-75a2e55cd728 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:01.384485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:01.400203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5fc8-b7ad-4fb7-90c7-bc098ccdb21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:01.401441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5fc8-b7ad-4fb7-90c7-bc098ccdb21f None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:01.401730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5fc8-b7ad-4fb7-90c7-bc098ccdb21f None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:01.402001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5fc8-b7ad-4fb7-90c7-bc098ccdb21f None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:01.402784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5fc8-b7ad-4fb7-90c7-bc098ccdb21f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:01.403089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5fc8-b7ad-4fb7-90c7-bc098ccdb21f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:01.404577 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5fc8-b7ad-4fb7-90c7-bc098ccdb21f None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:01.424856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 597/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:07:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:01.425925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:01.552891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8267f-4b07-4700-9b0a-af5db036f2f0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:01.593680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:01.602178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af4c16-e637-4ab9-bd66-302d6ea64fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:01.602849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af4c16-e637-4ab9-bd66-302d6ea64fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:01.603125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af4c16-e637-4ab9-bd66-302d6ea64fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:01.603401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af4c16-e637-4ab9-bd66-302d6ea64fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:01.604320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af4c16-e637-4ab9-bd66-302d6ea64fc3 None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=ee535097c03140178d287921bc1752b6) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:01.604867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af4c16-e637-4ab9-bd66-302d6ea64fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:01.606967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af4c16-e637-4ab9-bd66-302d6ea64fc3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:01.613934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 622/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:07:01 2022] GET /identity/v3/role_assignments?user.id=ee535097c03140178d287921bc1752b6&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:03.691845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e3960-4de3-4e43-87c4-015c181f25dd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:03.692400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e3960-4de3-4e43-87c4-015c181f25dd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:03.692535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e3960-4de3-4e43-87c4-015c181f25dd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:03.694257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 598/1220] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:07:03.699630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a0e2-9ace-4652-b3ad-b52b6e18d914 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:03.700180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a0e2-9ace-4652-b3ad-b52b6e18d914 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:03.700275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211a0e2-9ace-4652-b3ad-b52b6e18d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:03.717177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0211a0e2-9ace-4652-b3ad-b52b6e18d914 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:03.718678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0211a0e2-9ace-4652-b3ad-b52b6e18d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:03.819866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 623/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:07:03.851220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e3960-4de3-4e43-87c4-015c181f25dd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:03.996066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e3960-4de3-4e43-87c4-015c181f25dd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:04.037663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920850-16a4-4fd3-b51d-5a463c68d9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:04.038479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920850-16a4-4fd3-b51d-5a463c68d9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:04.038763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920850-16a4-4fd3-b51d-5a463c68d9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:04.039047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4920850-16a4-4fd3-b51d-5a463c68d9d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:04.051397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4920850-16a4-4fd3-b51d-5a463c68d9d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-d4920850-16a4-4fd3-b51d-5a463c68d9d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:07:04.059439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:04.061419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:07:04.063150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:04.065933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 599/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:07:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:04.067272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211a0e2-9ace-4652-b3ad-b52b6e18d914 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:04.196975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211a0e2-9ace-4652-b3ad-b52b6e18d914 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:04.236132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:04.256901 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:04.258332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:04.258828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:04.259292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:04.260688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:04.261168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:04.263315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:04.283687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 624/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:07:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:04.284989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920850-16a4-4fd3-b51d-5a463c68d9d6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:04.361827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:04.452224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4920850-16a4-4fd3-b51d-5a463c68d9d6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:04.499759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:04.501376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:04.503765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:04.510909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:04.534267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:04.537126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:04.571146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:04.573067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:04.574933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:04.574933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:04.574933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:04.574933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:04.574933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 600/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:04.580217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:04.730979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3314-176c-4551-8868-4ba6ac66e8d4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:04.772936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:04.773626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:04.774095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:04.774404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:04.775187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:04.776202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:04.777746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:04.800958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 625/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:04.808343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:04.970172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:04.981885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214b8fc-b553-4e80-9cb8-4d80dec39367 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:05.033930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:05.035292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:05.035786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:05.036314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:05.050625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:05.053052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:07:05.074169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:05.076004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:05.077120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 601/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:05.085380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:05.145852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:05.226844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d845c56-3dc6-4059-8ee8-f8a7ae140113 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:05.281478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:05.282121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:05.282375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:05.282657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:05.283623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:05.283939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:05.285560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:05.310027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 626/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Jul 14 11:07:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:05.316455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:05.451929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34159fca-17a0-4547-8c4d-8053cd15b495 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:05.507165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:05.508346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:05.508734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:05.509445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:05.523593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:05.526283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:05.547282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:05.549148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:05.550869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:05.550869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:05.550869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:05.550869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:05.553595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 602/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:05.555265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:05.722467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3201441-115b-43ca-a23b-d4bb9d34a7cb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:05.727083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:05.769812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:05.770920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:05.770920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:05.771228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:05.771930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:05.772282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:05.773763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:05.788544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 627/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:05.795126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:05.805690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:05.942857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da23c26-89b6-4ba0-87cb-bb2be81262bf None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:05.993441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:05.994793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:05.995308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:05.995687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:06.006185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:06.008546 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:07:06.030675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:06.032215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:06.033395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 603/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:06.041434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:06.218165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1715fe8-1ca8-424e-bd75-588694035cd7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:06.276343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb1a7e-da44-4710-aa07-d058d05fc403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:06.277533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1a7e-da44-4710-aa07-d058d05fc403 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:06.278031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1a7e-da44-4710-aa07-d058d05fc403 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:06.278527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb1a7e-da44-4710-aa07-d058d05fc403 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:06.280071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb1a7e-da44-4710-aa07-d058d05fc403 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:06.280645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb1a7e-da44-4710-aa07-d058d05fc403 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:06.283407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb1a7e-da44-4710-aa07-d058d05fc403 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:06.310866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 628/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:07:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:06.311989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:06.401345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:06.448723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b341eaa7-2589-4a42-a163-a60f03fb3b26 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:06.500496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881c923-cebc-4d5b-a020-a0a71463d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:06.501860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c923-cebc-4d5b-a020-a0a71463d8c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:06.502180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c923-cebc-4d5b-a020-a0a71463d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:06.502545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c923-cebc-4d5b-a020-a0a71463d8c9 None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/ee535097c03140178d287921bc1752b6/roles/abfe24af6ff444fcbd747639e12c2a73` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:06.536443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881c923-cebc-4d5b-a020-a0a71463d8c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=ee535097c03140178d287921bc1752b6, role_id=abfe24af6ff444fcbd747639e12c2a73)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:06.539642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881c923-cebc-4d5b-a020-a0a71463d8c9 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:06.559846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 604/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:07:06 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/ee535097c03140178d287921bc1752b6/roles/abfe24af6ff444fcbd747639e12c2a73 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:07:08.948490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ab59-efd9-4865-bb9b-f65883a6e884 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:08.949088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ab59-efd9-4865-bb9b-f65883a6e884 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:08.949657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13ab59-efd9-4865-bb9b-f65883a6e884 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:08.952283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 629/1233] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:07:08.960949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d438d7-6b59-44d0-ab61-0a91edd402ac None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:08.961543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d438d7-6b59-44d0-ab61-0a91edd402ac None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:08.961543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d438d7-6b59-44d0-ab61-0a91edd402ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:08.981476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-21d438d7-6b59-44d0-ab61-0a91edd402ac None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:08.982725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-21d438d7-6b59-44d0-ab61-0a91edd402ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:09.066285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 605/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:07:09.091927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13ab59-efd9-4865-bb9b-f65883a6e884 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:09.121320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:09.233658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13ab59-efd9-4865-bb9b-f65883a6e884 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:09.292020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8533ef-4bc2-4115-a704-6d9bdfa51217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:09.292868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8533ef-4bc2-4115-a704-6d9bdfa51217 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:09.293146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8533ef-4bc2-4115-a704-6d9bdfa51217 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:09.293507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8533ef-4bc2-4115-a704-6d9bdfa51217 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:09.306004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8533ef-4bc2-4115-a704-6d9bdfa51217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ae8533ef-4bc2-4115-a704-6d9bdfa51217 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:07:09.314453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:09.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:09.318380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 630/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Thu Jul 14 11:07:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:09.324571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d438d7-6b59-44d0-ab61-0a91edd402ac None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:09.401080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:09.484183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d438d7-6b59-44d0-ab61-0a91edd402ac None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:09.537586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:09.538289 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:09.538572 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:09.538850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:09.539617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] RBAC: Adding query filter params (name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:09.539925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:09.541901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:09.557888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 606/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Thu Jul 14 11:07:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:09.564883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8533ef-4bc2-4115-a704-6d9bdfa51217 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:09.660802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:09.679984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8533ef-4bc2-4115-a704-6d9bdfa51217 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:09.725057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:09.725848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:09.726134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:09.726411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:09.739488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:09.740931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:09.760522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:09.763131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:09.765270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:09.765270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:09.765270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:09.765270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:09.765270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 631/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:09.768588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:09.919272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc18cb-2f2f-4cc2-8d56-671989b1d151 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:09.930260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:09.965456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:09.966508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:09.966508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:09.966807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:09.967461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:09.967791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:09.969273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:09.989377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 607/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:09.996404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:10.164270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac60a0-c1d3-44fd-b791-260af6979459 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:10.212893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59b237-8585-403d-b486-c40442048561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:10.213866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b237-8585-403d-b486-c40442048561 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:10.214074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b237-8585-403d-b486-c40442048561 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:10.214379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b237-8585-403d-b486-c40442048561 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:10.218973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:10.225119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59b237-8585-403d-b486-c40442048561 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:10.226772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59b237-8585-403d-b486-c40442048561 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ca59b237-8585-403d-b486-c40442048561 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:07:10.244233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:10.247130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:10.249613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:10.251993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 632/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:10.252275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:10.385663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d9d6-22bf-4a4f-aeff-77e435b59527 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:10.436010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:10.436781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:10.437066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:10.437388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:10.438246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:10.438557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:10.440206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:10.462051 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 608/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Jul 14 11:07:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:10.469686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59b237-8585-403d-b486-c40442048561 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:10.621432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59b237-8585-403d-b486-c40442048561 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:10.673879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b0aee-879b-47be-aaa4-f96e2bc3d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:10.674857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b0aee-879b-47be-aaa4-f96e2bc3d562 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:10.675292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b0aee-879b-47be-aaa4-f96e2bc3d562 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:10.675729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b0aee-879b-47be-aaa4-f96e2bc3d562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:10.769424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:10.778206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b0aee-879b-47be-aaa4-f96e2bc3d562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:10.779910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b0aee-879b-47be-aaa4-f96e2bc3d562 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:10.954119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 633/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:07:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:07:10.955663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:11.002218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:11.111146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4174a4-d8d9-4b98-a765-bbef4634f6a6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:11.159296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:11.160267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:11.160599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:11.160962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:11.177475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:11.179052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:11.200796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:11.202428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:11.203439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:11.203439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:11.203439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:11.203439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:11.203439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 609/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:07:11.211863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b0aee-879b-47be-aaa4-f96e2bc3d562 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:11.351385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:11.360213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b0aee-879b-47be-aaa4-f96e2bc3d562 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:11.405719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:11.406796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:11.407261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:11.407762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:11.408882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:11.409327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:11.411584 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:11.429267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 634/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:11.435273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:11.562552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:11.601703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b69a7-dd35-49a0-a543-3a496aef686d None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:11.664305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:11.665402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:11.665758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:11.666235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:11.677107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:11.679057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:07:11.699786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:11.701786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:11.703210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 610/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:11.709577 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:11.878265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07d2b2-6d90-403a-8635-dce93ffaed31 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:11.926431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3aa219-7468-474f-aec5-f6c0a69b51bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:11.927263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aa219-7468-474f-aec5-f6c0a69b51bf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:11.927604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aa219-7468-474f-aec5-f6c0a69b51bf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:11.927990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3aa219-7468-474f-aec5-f6c0a69b51bf None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:11.929176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aa219-7468-474f-aec5-f6c0a69b51bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:11.929718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aa219-7468-474f-aec5-f6c0a69b51bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:11.932096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3aa219-7468-474f-aec5-f6c0a69b51bf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:11.954428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 635/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:07:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:11.961358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:12.090249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993a3fa-5b49-4a59-a1b9-c076cdb1abab None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:12.139501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002119-11bb-4eee-b30a-060de39569ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:12.140587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002119-11bb-4eee-b30a-060de39569ee None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:12.141066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002119-11bb-4eee-b30a-060de39569ee None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:12.141525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002119-11bb-4eee-b30a-060de39569ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:12.143146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002119-11bb-4eee-b30a-060de39569ee None admin] RBAC: Adding query filter params (role.id=abfe24af6ff444fcbd747639e12c2a73, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=ee535097c03140178d287921bc1752b6) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:12.143688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002119-11bb-4eee-b30a-060de39569ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:12.146463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002119-11bb-4eee-b30a-060de39569ee None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:12.158947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 611/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:07:11 2022] GET /identity/v3/role_assignments?user.id=ee535097c03140178d287921bc1752b6&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=abfe24af6ff444fcbd747639e12c2a73 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:14.652322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a25a48-448b-4f40-a98b-09e07e8604be None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:14.653148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a25a48-448b-4f40-a98b-09e07e8604be None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:14.653148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a25a48-448b-4f40-a98b-09e07e8604be None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:14.654305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 636/1247] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:07:14.662040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce249-d74f-46ef-ab85-0973c209c979 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:14.662968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce249-d74f-46ef-ab85-0973c209c979 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:14.663115 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce249-d74f-46ef-ab85-0973c209c979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:14.669735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:14.687435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dffce249-d74f-46ef-ab85-0973c209c979 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:14.689536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dffce249-d74f-46ef-ab85-0973c209c979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:14.805241 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 612/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:07:14.832565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a25a48-448b-4f40-a98b-09e07e8604be None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:14.858170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:15.007365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a25a48-448b-4f40-a98b-09e07e8604be None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:15.064996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513332f6-58e7-47ed-aab3-748bdd16e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:15.066066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513332f6-58e7-47ed-aab3-748bdd16e834 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:15.066635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513332f6-58e7-47ed-aab3-748bdd16e834 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:15.067048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513332f6-58e7-47ed-aab3-748bdd16e834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:15.083661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513332f6-58e7-47ed-aab3-748bdd16e834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-513332f6-58e7-47ed-aab3-748bdd16e834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:07:15.094774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:15.097363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:15.099733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 637/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:07:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:15.104747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffce249-d74f-46ef-ab85-0973c209c979 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:15.273235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffce249-d74f-46ef-ab85-0973c209c979 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:15.320515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:15.329766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:15.330953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:15.331466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:15.331962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:15.333495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:15.334011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:15.336758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:15.354234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 613/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:07:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:15.360858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513332f6-58e7-47ed-aab3-748bdd16e834 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:15.487186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:15.525865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513332f6-58e7-47ed-aab3-748bdd16e834 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:15.577235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:15.578562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:15.579061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:15.579555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:15.601547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:15.604460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:15.639043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:15.640657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:15.643103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:15.643103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:15.643103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:15.643103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:15.643103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 638/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:15.648645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:15.837954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625901-da99-469d-96f4-6264af3b6b5c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:15.896789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:15.897920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:15.898401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:15.898870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:15.899782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:15.900178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:15.902656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:15.921563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 614/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:15.927809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:16.090958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc268e9-bab6-4ac9-9332-04fb5360c669 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:16.132970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:16.146005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:16.147357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:16.147616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:16.148016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:16.165426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:16.168739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:07:16.194521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:16.196445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:16.197706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 639/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:07:16.204952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:16.321760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:16.388493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f9759-4be6-4c1c-b505-b545cb849158 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:16.441128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:16.442298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:16.442806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:16.443540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:16.445271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:16.445955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:16.449094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:16.487210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 615/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Jul 14 11:07:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:16.497056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:16.675492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e653f64-17a0-479e-b291-a7ec30c562c9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:16.732864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdcfad-9ede-4791-9d20-851d7d28270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:16.733794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdcfad-9ede-4791-9d20-851d7d28270f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:16.734214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdcfad-9ede-4791-9d20-851d7d28270f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:16.734614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdcfad-9ede-4791-9d20-851d7d28270f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:16.833879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:16.859158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdcfad-9ede-4791-9d20-851d7d28270f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:16.860892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fdcfad-9ede-4791-9d20-851d7d28270f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:17.023866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 640/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:07:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 11:07:17.030692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:17.184395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bcbe3-da35-4529-9b5f-0286cf50c037 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:17.205889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:17.253550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:17.255861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:17.256402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:17.256868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:17.276774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:17.279002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:17.305117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:17.307689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:17.309770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:17.309770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:17.309770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:17.309770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:17.309770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 616/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:07:17.315760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdcfad-9ede-4791-9d20-851d7d28270f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:17.437177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:17.458196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdcfad-9ede-4791-9d20-851d7d28270f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:17.521653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:17.522830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:17.523369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:17.523903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:17.525553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:17.526441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:17.529117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:17.544690 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 641/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:17.551808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:17.729500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd285a-50e6-409d-a22e-eb77988e4fd6 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:17.788000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:17.789044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:17.789465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:17.789861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:17.800386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:17.802261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:07:17.822678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:17.824403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:17.826153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 617/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:17.832806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:17.991021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efecb38-3771-4f8a-b1a1-141db464322b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:18.041440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b6e2e-9049-4c10-9b09-eb2e6f5021db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:18.042592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b6e2e-9049-4c10-9b09-eb2e6f5021db None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:18.042592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b6e2e-9049-4c10-9b09-eb2e6f5021db None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:18.042592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b6e2e-9049-4c10-9b09-eb2e6f5021db None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:18.043369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b6e2e-9049-4c10-9b09-eb2e6f5021db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:18.043685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b6e2e-9049-4c10-9b09-eb2e6f5021db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:18.045245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b6e2e-9049-4c10-9b09-eb2e6f5021db None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:18.061155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 642/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:18.071617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:18.121609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:18.277489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac041f-d87f-4e7d-af7d-19ad2353aa1b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:18.334611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444b633-c810-4d28-8c0e-be6727e966ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:18.335842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444b633-c810-4d28-8c0e-be6727e966ac None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:18.336444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444b633-c810-4d28-8c0e-be6727e966ac None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:18.337074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444b633-c810-4d28-8c0e-be6727e966ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:18.339389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444b633-c810-4d28-8c0e-be6727e966ac None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=ee535097c03140178d287921bc1752b6) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:18.339988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444b633-c810-4d28-8c0e-be6727e966ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:18.342812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444b633-c810-4d28-8c0e-be6727e966ac None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:18.368147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 618/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:07:18 2022] GET /identity/v3/role_assignments?user.id=ee535097c03140178d287921bc1752b6&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:20.630949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832281-ee2b-4dd2-8800-ab02cb28720e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:20.631619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832281-ee2b-4dd2-8800-ab02cb28720e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:20.631619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea832281-ee2b-4dd2-8800-ab02cb28720e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:20.632983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 643/1261] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:07:20.639770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1a08-402b-4bca-b28b-3e90c8583ab5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:20.640431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1a08-402b-4bca-b28b-3e90c8583ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:20.640431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce1a08-402b-4bca-b28b-3e90c8583ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:20.658860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5cce1a08-402b-4bca-b28b-3e90c8583ab5 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:20.660012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5cce1a08-402b-4bca-b28b-3e90c8583ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:20.740305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 619/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:07:20.764076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea832281-ee2b-4dd2-8800-ab02cb28720e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:20.777005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:20.880231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea832281-ee2b-4dd2-8800-ab02cb28720e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:20.919457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30327534-d20d-4b90-98ec-2ff02697cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:20.920303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30327534-d20d-4b90-98ec-2ff02697cdec None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:20.920594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30327534-d20d-4b90-98ec-2ff02697cdec None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:20.920876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30327534-d20d-4b90-98ec-2ff02697cdec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:20.933130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30327534-d20d-4b90-98ec-2ff02697cdec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-30327534-d20d-4b90-98ec-2ff02697cdec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:07:20.941548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:20.943766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:20.945470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 644/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:07:20.950283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce1a08-402b-4bca-b28b-3e90c8583ab5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:20.971971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:21.064796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce1a08-402b-4bca-b28b-3e90c8583ab5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:21.104353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:21.105045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:21.105325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:21.105600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:21.106375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:21.106679 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:21.108142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:21.117634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 620/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:21.127977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30327534-d20d-4b90-98ec-2ff02697cdec None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:21.205044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:21.254460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30327534-d20d-4b90-98ec-2ff02697cdec None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:21.305552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:21.306908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:21.307196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:21.307474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:21.320198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:21.321717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:21.341289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:21.342388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:21.343408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:21.343408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:21.343408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:21.343408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:21.343408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 645/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:21.349252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:21.448220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:21.481091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200d796-2c06-491a-9c6e-a87bbd5bc44b None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:21.521425 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:21.522161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:21.522485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:21.522799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:21.523603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:21.523949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:21.525512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:21.540330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 621/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:21.547038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:21.667442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821a688-2e01-45b5-a4be-25eb3f0c03e5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:21.691387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:21.707835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:21.708705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:21.708995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:21.709277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:21.718494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:21.720014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:07:21.737010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:21.748287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:21.750239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 646/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:07:21.751463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:21.936547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414f5c0-314f-47a2-9d1f-3c0cf6fe2556 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:21.999013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:22.000046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:22.000563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:22.001030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:22.002587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:22.003124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:22.005828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:22.022463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:22.033085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 622/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Jul 14 11:07:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:22.041907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:22.156199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179dda-2063-440e-a28b-d568ef23ac34 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:22.193996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:22.194807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:22.195093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:22.195370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:22.208876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:22.210246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:22.230798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:22.232899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:22.234988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:22.234988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:22.234988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:22.234988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:22.234988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 647/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:22.238441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:22.420587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41164f0a-edaf-46ea-9062-d8d586ab24d4 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:22.463363 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:22.464049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:22.464370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:22.464649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:22.465393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:22.465700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:22.467141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:22.482196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 623/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:22.488515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:22.525834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:22.606401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116784b-43f3-4f26-8644-ad8e30f4ae03 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:22.646882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:22.647702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:22.647985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:22.648292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:22.656081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:22.657638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:07:22.674292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:22.676567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:22.677753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 648/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:07:22.684726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:22.762002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:22.810399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0274d-5969-415f-8000-d1010f805ca7 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:22.852220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9b2c7-f2ee-4c73-b9d1-da73257cc6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:22.852902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9b2c7-f2ee-4c73-b9d1-da73257cc6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:22.853185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9b2c7-f2ee-4c73-b9d1-da73257cc6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:22.853503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9b2c7-f2ee-4c73-b9d1-da73257cc6b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:22.854313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9b2c7-f2ee-4c73-b9d1-da73257cc6b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:22.854622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9b2c7-f2ee-4c73-b9d1-da73257cc6b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:22.856094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9b2c7-f2ee-4c73-b9d1-da73257cc6b5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:22.872198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 624/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:22.878542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:22.984370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:22.995688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86af05-a6f1-474a-af83-568da1bf5c82 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:23.033780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26960d-d0d6-4cf8-a8d5-5c479396fc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:23.034692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26960d-d0d6-4cf8-a8d5-5c479396fc0b None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:23.034973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26960d-d0d6-4cf8-a8d5-5c479396fc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:23.035248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26960d-d0d6-4cf8-a8d5-5c479396fc0b None admin] PATH_INFO: `/v3/projects/71894a85f39844e8b4ed12f827930b19/users/ee535097c03140178d287921bc1752b6/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:23.037422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26960d-d0d6-4cf8-a8d5-5c479396fc0b None admin] RBAC: Authorizing `identity:create_grant(project_id=71894a85f39844e8b4ed12f827930b19, user_id=ee535097c03140178d287921bc1752b6, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:23.038914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26960d-d0d6-4cf8-a8d5-5c479396fc0b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:23.054412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 649/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Thu Jul 14 11:07:22 2022] PUT /identity/v3/projects/71894a85f39844e8b4ed12f827930b19/users/ee535097c03140178d287921bc1752b6/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:07:25.237082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139cdf6-a1e2-4634-9590-650c6dc94859 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:25.237711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139cdf6-a1e2-4634-9590-650c6dc94859 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:25.237711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139cdf6-a1e2-4634-9590-650c6dc94859 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:25.239180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 625/1274] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:07:25.246114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ac06-7642-45c0-ae10-2c99a97fa271 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:25.246978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ac06-7642-45c0-ae10-2c99a97fa271 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:25.247172 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70ac06-7642-45c0-ae10-2c99a97fa271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:25.274343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fb70ac06-7642-45c0-ae10-2c99a97fa271 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:25.277049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fb70ac06-7642-45c0-ae10-2c99a97fa271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:25.370685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 650/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:07:25.395209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139cdf6-a1e2-4634-9590-650c6dc94859 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:25.522520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139cdf6-a1e2-4634-9590-650c6dc94859 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:25.546929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:25.569170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919b09-6735-410b-b478-fef8579d0d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:25.570170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b09-6735-410b-b478-fef8579d0d56 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:25.570499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b09-6735-410b-b478-fef8579d0d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:25.570953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b09-6735-410b-b478-fef8579d0d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:25.585053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0919b09-6735-410b-b478-fef8579d0d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f0919b09-6735-410b-b478-fef8579d0d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 11:07:25.594053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:25.595990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:25.597684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 626/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Thu Jul 14 11:07:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:07:25.602194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70ac06-7642-45c0-ae10-2c99a97fa271 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:25.694108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:25.726800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70ac06-7642-45c0-ae10-2c99a97fa271 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:25.792955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:25.794029 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:25.794515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:25.797437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:25.801975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:25.802526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:25.805169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:25.822768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 651/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Thu Jul 14 11:07:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:25.829332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919b09-6735-410b-b478-fef8579d0d56 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:25.950576 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919b09-6735-410b-b478-fef8579d0d56 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:25.991460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:25.992311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:25.992600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:25.992870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:26.006101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:26.007587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:26.026933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:26.028069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:26.029365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:26.029365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:26.029365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:26.029365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:26.029365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 627/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 11:07:26.035066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:26.179111 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712ea23-a91f-4398-bd64-a2c889c0814d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:26.223697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:26.224656 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:26.224991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:26.225451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:26.226007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:26.226540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:26.227789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:26.242853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 652/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:26.249539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:26.286560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:26.366891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46445a82-f803-4ada-9f35-e46cc17c192c None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:26.406733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:26.407561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:26.407840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:26.408153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:26.417627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:26.419174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 11:07:26.435781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:26.437540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:26.438560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 628/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:26.447080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:26.453733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:26.595921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bb961-c99d-4bd0-a051-8d0548fe242c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:26.633277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:26.633965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:26.634247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:26.635028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:26.635882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:26.636215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:26.637728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:26.660211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 653/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Thu Jul 14 11:07:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:26.666879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:26.773770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:26.786134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3089c-1044-4dc2-91d3-462b6eb7b7b0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:26.825842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc57d2-d394-42fe-ac23-23e6fddab345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:26.826501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc57d2-d394-42fe-ac23-23e6fddab345 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:26.826785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc57d2-d394-42fe-ac23-23e6fddab345 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:26.827095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc57d2-d394-42fe-ac23-23e6fddab345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:26.903733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc57d2-d394-42fe-ac23-23e6fddab345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:26.905250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc57d2-d394-42fe-ac23-23e6fddab345 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:27.007879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:27.019890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 629/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Thu Jul 14 11:07:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 11:07:27.026944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:27.094383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:27.138632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41b8e4-0917-4ddb-ae36-bc26ed6d8f3e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:27.177782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:27.178592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:27.178869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:27.179144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:27.190676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:27.192301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 11:07:27.214746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:27.216511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:27.217795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 11:07:27.217795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 11:07:27.217795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 11:07:27.217795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:27.217795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 654/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:27.222142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc57d2-d394-42fe-ac23-23e6fddab345 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:27.334082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc57d2-d394-42fe-ac23-23e6fddab345 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:27.372640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:27.373316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:27.373599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:27.373872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:27.374617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:27.374920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:27.376354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:27.389570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 630/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Thu Jul 14 11:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:27.399286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:27.540473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21080aef-a53b-465f-a2b5-35394384d90c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:27.557256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:27.583337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:27.584239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:27.584460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:27.584734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:27.593383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:27.595007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 11:07:27.610440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:27.612091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: ERROR keystone.server.flask.application Jul 14 11:07:27.613616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 655/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Thu Jul 14 11:07:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:27.621099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:27.679638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:27.741290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26374c3-8a79-4e73-ada0-df2edb9fe47a None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:27.782519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03983dc-4f12-44cc-9348-86a799f8a850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:27.785085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03983dc-4f12-44cc-9348-86a799f8a850 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:27.785367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03983dc-4f12-44cc-9348-86a799f8a850 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:27.785640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03983dc-4f12-44cc-9348-86a799f8a850 None admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:27.786488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03983dc-4f12-44cc-9348-86a799f8a850 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:27.786798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03983dc-4f12-44cc-9348-86a799f8a850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:27.788335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03983dc-4f12-44cc-9348-86a799f8a850 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:27.804242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 631/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Thu Jul 14 11:07:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:27.811247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:27.932251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4937c-51eb-4225-b2d1-70e8366ba0fa None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:27.972686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e7438-7309-47e4-b532-ff8908e5fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:27.973360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7438-7309-47e4-b532-ff8908e5fe88 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:27.973645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7438-7309-47e4-b532-ff8908e5fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:27.973919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e7438-7309-47e4-b532-ff8908e5fe88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:27.974778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e7438-7309-47e4-b532-ff8908e5fe88 None admin] RBAC: Adding query filter params (role.id=1f3292d7ab5149c6bd893360af5355dc, scope.project.id=71894a85f39844e8b4ed12f827930b19, user.id=ee535097c03140178d287921bc1752b6) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:27.975091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e7438-7309-47e4-b532-ff8908e5fe88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:27.976618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e7438-7309-47e4-b532-ff8908e5fe88 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:27.983634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 656/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Thu Jul 14 11:07:27 2022] GET /identity/v3/role_assignments?user.id=ee535097c03140178d287921bc1752b6&scope.project.id=71894a85f39844e8b4ed12f827930b19&role.id=1f3292d7ab5149c6bd893360af5355dc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:30.176683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbe37-5832-4484-801a-b4a98e3d2d5c None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:30.177563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbe37-5832-4484-801a-b4a98e3d2d5c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:30.177563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bbe37-5832-4484-801a-b4a98e3d2d5c None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:30.179311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 632/1288] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:07:30.186113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972dd8c-0685-4fea-bb8f-0d8f62ca643c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:30.186688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972dd8c-0685-4fea-bb8f-0d8f62ca643c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:30.186688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972dd8c-0685-4fea-bb8f-0d8f62ca643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:30.205363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9972dd8c-0685-4fea-bb8f-0d8f62ca643c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:30.206629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9972dd8c-0685-4fea-bb8f-0d8f62ca643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:30.245526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:30.296179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 657/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:07:30.323305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bbe37-5832-4484-801a-b4a98e3d2d5c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:30.447752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bbe37-5832-4484-801a-b4a98e3d2d5c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:30.461308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:30.488841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:30.489658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:30.489938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:30.490207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:30.490867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:30.492429 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:30.506035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:30.507997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:30.509963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 633/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:07:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:30.515983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972dd8c-0685-4fea-bb8f-0d8f62ca643c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:30.632881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972dd8c-0685-4fea-bb8f-0d8f62ca643c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:30.675923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fc0fd-b983-47b0-835a-42f9f189ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:30.677059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fc0fd-b983-47b0-835a-42f9f189ab9b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:30.677551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fc0fd-b983-47b0-835a-42f9f189ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:30.678038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fc0fd-b983-47b0-835a-42f9f189ab9b None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:30.679275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fc0fd-b983-47b0-835a-42f9f189ab9b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:30.679817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fc0fd-b983-47b0-835a-42f9f189ab9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:30.683090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fc0fd-b983-47b0-835a-42f9f189ab9b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:30.693021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 658/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Thu Jul 14 11:07:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:30.699973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:30.819943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae5c6b-d029-4d30-8030-86303a1b12f3 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:30.858279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad80577-d821-4d34-964a-5cb5148958a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:30.858997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80577-d821-4d34-964a-5cb5148958a8 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:30.859281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80577-d821-4d34-964a-5cb5148958a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:30.859560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80577-d821-4d34-964a-5cb5148958a8 None admin] PATH_INFO: `/v3/services` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:30.860341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad80577-d821-4d34-964a-5cb5148958a8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:30.860653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad80577-d821-4d34-964a-5cb5148958a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:30.862094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad80577-d821-4d34-964a-5cb5148958a8 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:30.867595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 634/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Thu Jul 14 11:07:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:33.067246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4289-6ac3-4280-962a-35ab9bcfc29e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:33.067834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4289-6ac3-4280-962a-35ab9bcfc29e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:33.067834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab4289-6ac3-4280-962a-35ab9bcfc29e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:33.069537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 659/1293] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:07:33.077469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae3d88-2500-49e6-a6da-3ba894b022a7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:33.078077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae3d88-2500-49e6-a6da-3ba894b022a7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:33.078077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae3d88-2500-49e6-a6da-3ba894b022a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:33.095964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7fae3d88-2500-49e6-a6da-3ba894b022a7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:33.097301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7fae3d88-2500-49e6-a6da-3ba894b022a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:33.131597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:33.176670 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 635/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 11:07:33.201669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4289-6ac3-4280-962a-35ab9bcfc29e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:33.252144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:33.348171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab4289-6ac3-4280-962a-35ab9bcfc29e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:33.388916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abe9ac-4ddb-481d-a5a2-d673eb7e25f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:33.389596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe9ac-4ddb-481d-a5a2-d673eb7e25f0 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:33.389885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe9ac-4ddb-481d-a5a2-d673eb7e25f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:33.390170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abe9ac-4ddb-481d-a5a2-d673eb7e25f0 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:33.390926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abe9ac-4ddb-481d-a5a2-d673eb7e25f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:33.392394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abe9ac-4ddb-481d-a5a2-d673eb7e25f0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:33.407926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 660/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Thu Jul 14 11:07:33 2022] POST /identity/v3/services => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:07:35.647895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881f0c-ebf8-4648-97a0-94db04200295 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:35.648523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881f0c-ebf8-4648-97a0-94db04200295 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:35.648523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881f0c-ebf8-4648-97a0-94db04200295 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:35.649930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 636/1296] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:07:35.656989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99e8b-8bcf-47eb-b9c2-ed306f6d6381 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:35.657550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99e8b-8bcf-47eb-b9c2-ed306f6d6381 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:35.657974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a99e8b-8bcf-47eb-b9c2-ed306f6d6381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:35.687864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c9a99e8b-8bcf-47eb-b9c2-ed306f6d6381 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:35.689989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c9a99e8b-8bcf-47eb-b9c2-ed306f6d6381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:35.824080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 661/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:07:35.847587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad881f0c-ebf8-4648-97a0-94db04200295 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:35.970252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad881f0c-ebf8-4648-97a0-94db04200295 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:36.009469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:36.010294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:36.010575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:36.010851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:36.011530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:36.013067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:36.026596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:36.028468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:36.030195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 637/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:07:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:36.036288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a99e8b-8bcf-47eb-b9c2-ed306f6d6381 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:36.056879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:36.152285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a99e8b-8bcf-47eb-b9c2-ed306f6d6381 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:36.191866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:36.192586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:36.192872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:36.193153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:36.194158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:36.194505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:36.195979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:36.203022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 662/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Thu Jul 14 11:07:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:07:36.209955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:36.256080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:36.335853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256d614-273e-4d2b-a8e5-1237153b3475 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:36.374978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd848ac8-5e8a-452e-8c0e-ea3130702ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:36.375655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848ac8-5e8a-452e-8c0e-ea3130702ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:36.375938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848ac8-5e8a-452e-8c0e-ea3130702ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:36.376256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd848ac8-5e8a-452e-8c0e-ea3130702ab0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:36.377074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd848ac8-5e8a-452e-8c0e-ea3130702ab0 None admin] RBAC: Adding query filter params (interface=public, service_id=5c61fc0e3b3d4160af3567057d2a14a4, region_id=RegionOne) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:36.377384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd848ac8-5e8a-452e-8c0e-ea3130702ab0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:36.378798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd848ac8-5e8a-452e-8c0e-ea3130702ab0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:36.385346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 638/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Thu Jul 14 11:07:36 2022] GET /identity/v3/endpoints?service_id=5c61fc0e3b3d4160af3567057d2a14a4&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:36.391499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:36.487865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:36.510482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be39b72-819f-49ec-bb84-06fc7a847e9d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:36.554570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a02d5-fa30-4f5e-bd34-d379f92f305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:36.555243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a02d5-fa30-4f5e-bd34-d379f92f305f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:36.555531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a02d5-fa30-4f5e-bd34-d379f92f305f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:36.555812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a02d5-fa30-4f5e-bd34-d379f92f305f None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:36.557164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a02d5-fa30-4f5e-bd34-d379f92f305f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:36.558605 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a02d5-fa30-4f5e-bd34-d379f92f305f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:36.567314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 663/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Thu Jul 14 11:07:36 2022] GET /identity/v3/services => generated 2191 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:07:38.722086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380fc96-3728-4fff-8cf0-aab060116bae None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:38.722710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380fc96-3728-4fff-8cf0-aab060116bae None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:38.722881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380fc96-3728-4fff-8cf0-aab060116bae None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:38.724439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 639/1302] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:07:38.732078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82c21-782f-4793-a547-7839089b9bb9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:38.732711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82c21-782f-4793-a547-7839089b9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:38.732711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d82c21-782f-4793-a547-7839089b9bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:38.752068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a7d82c21-782f-4793-a547-7839089b9bb9 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:07:38.753448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a7d82c21-782f-4793-a547-7839089b9bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:07:38.832615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 664/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:07:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 11:07:38.874712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380fc96-3728-4fff-8cf0-aab060116bae None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:38.986073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:38.994204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380fc96-3728-4fff-8cf0-aab060116bae None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:39.034721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:39.035543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:39.035830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:39.036146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:39.036804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:39.038239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 11:07:39.051941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 11:07:39.053630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application with Lock( Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self._enter() Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application return self.creator() Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application created_value = creator( Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: ERROR keystone.server.flask.application Jul 14 11:07:39.054510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 640/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Thu Jul 14 11:07:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 11:07:39.063055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d82c21-782f-4793-a547-7839089b9bb9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:39.151741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:39.180252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d82c21-782f-4793-a547-7839089b9bb9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:39.220681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f96566-9abb-4826-a532-cdcebf667ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:39.221421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96566-9abb-4826-a532-cdcebf667ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:39.221745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96566-9abb-4826-a532-cdcebf667ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:39.222067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f96566-9abb-4826-a532-cdcebf667ba3 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:39.222846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f96566-9abb-4826-a532-cdcebf667ba3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:07:39.223191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f96566-9abb-4826-a532-cdcebf667ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:39.224771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f96566-9abb-4826-a532-cdcebf667ba3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:39.231557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 665/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Thu Jul 14 11:07:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:07:39.237613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:07:39.356853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa548785-1123-4198-a5fc-947b7c718ac0 None admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:07:39.396036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa364-1cc8-4ef6-9a28-e7d5faf9b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:07:39.396751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa364-1cc8-4ef6-9a28-e7d5faf9b8e5 None admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:07:39.397037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa364-1cc8-4ef6-9a28-e7d5faf9b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:07:39.397310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa364-1cc8-4ef6-9a28-e7d5faf9b8e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:07:39.398081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aa364-1cc8-4ef6-9a28-e7d5faf9b8e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:07:39.399501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aa364-1cc8-4ef6-9a28-e7d5faf9b8e5 None admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:07:39.420852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 641/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Thu Jul 14 11:07:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:07:49.228273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=30 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:07:49.417228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:50.036873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1c0c-acda-435e-bacc-98ba63e8c80f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:50.037449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1c0c-acda-435e-bacc-98ba63e8c80f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:50.037449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af1c0c-acda-435e-bacc-98ba63e8c80f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:50.043072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 666/1307] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:08:50.045164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5274c0-3be9-4c16-a1b8-d3aa5111a060 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:50.045622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5274c0-3be9-4c16-a1b8-d3aa5111a060 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:50.045719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5274c0-3be9-4c16-a1b8-d3aa5111a060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:50.176058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7f5274c0-3be9-4c16-a1b8-d3aa5111a060 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:50.177243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7f5274c0-3be9-4c16-a1b8-d3aa5111a060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:50.422566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 642/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:08:50.495755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd058e0-c132-489a-96c7-4074784c08c6 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:50.496039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd058e0-c132-489a-96c7-4074784c08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:50.496346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd058e0-c132-489a-96c7-4074784c08c6 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:50.497992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 667/1309] 10.222.0.17 () {54 vars in 964 bytes} [Thu Jul 14 11:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:08:50.504356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60916009-e7be-48fd-a387-f6037a44dcf5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:50.504901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60916009-e7be-48fd-a387-f6037a44dcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:50.505340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60916009-e7be-48fd-a387-f6037a44dcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:50.685858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-60916009-e7be-48fd-a387-f6037a44dcf5 None None] MFA Rules not processed for user `a367d904a4a44e91862da4aea28a123b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:50.687135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-60916009-e7be-48fd-a387-f6037a44dcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:50.734628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:50.857369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 643/1310] 10.222.0.17 () {58 vars in 1061 bytes} [Thu Jul 14 11:08:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:50.868658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd058e0-c132-489a-96c7-4074784c08c6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:50.873674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2cd058e0-c132-489a-96c7-4074784c08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:51.019898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd058e0-c132-489a-96c7-4074784c08c6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:51.108840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ad4ca-cf97-4bb8-9d9c-5f1280a31eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:51.110303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ad4ca-cf97-4bb8-9d9c-5f1280a31eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:51.110751 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ad4ca-cf97-4bb8-9d9c-5f1280a31eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:51.111185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ad4ca-cf97-4bb8-9d9c-5f1280a31eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:51.113083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-791ad4ca-cf97-4bb8-9d9c-5f1280a31eb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:51.176224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:51.239771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ad4ca-cf97-4bb8-9d9c-5f1280a31eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:51.241368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ad4ca-cf97-4bb8-9d9c-5f1280a31eb8 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:51.262466 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 668/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:53.717568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8bc9c-a0ae-437b-82d5-b09b20025898 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:53.718101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8bc9c-a0ae-437b-82d5-b09b20025898 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:53.718101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8bc9c-a0ae-437b-82d5-b09b20025898 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:53.719408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 644/1312] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:08:53.724722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433844ee-56e1-4182-9470-f31f58f7925f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:53.725183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433844ee-56e1-4182-9470-f31f58f7925f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:53.725301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433844ee-56e1-4182-9470-f31f58f7925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:53.800625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-433844ee-56e1-4182-9470-f31f58f7925f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:53.801879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-433844ee-56e1-4182-9470-f31f58f7925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:53.900747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 669/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:08:53.940029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8bc9c-a0ae-437b-82d5-b09b20025898 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:53.941590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-33a8bc9c-a0ae-437b-82d5-b09b20025898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:54.045607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8bc9c-a0ae-437b-82d5-b09b20025898 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:54.118032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:54.120905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c1dea-f552-4e3f-b20c-4e7ea81551d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:54.121788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c1dea-f552-4e3f-b20c-4e7ea81551d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:54.122137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c1dea-f552-4e3f-b20c-4e7ea81551d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:54.122599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c1dea-f552-4e3f-b20c-4e7ea81551d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:54.124618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4c8c1dea-f552-4e3f-b20c-4e7ea81551d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:54.230896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c1dea-f552-4e3f-b20c-4e7ea81551d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:54.232362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c1dea-f552-4e3f-b20c-4e7ea81551d7 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:54.250630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 645/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:56.643425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467f87-4e80-4fb6-9f90-f7c5bd1f0818 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:56.643997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467f87-4e80-4fb6-9f90-f7c5bd1f0818 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:56.643997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54467f87-4e80-4fb6-9f90-f7c5bd1f0818 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:56.645513 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 670/1315] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:08:56.651641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c183c-58b3-4aad-a6b5-ce26b59abbf8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:56.652254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c183c-58b3-4aad-a6b5-ce26b59abbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:56.652254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c183c-58b3-4aad-a6b5-ce26b59abbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:56.723837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-348c183c-58b3-4aad-a6b5-ce26b59abbf8 None None] MFA Rules not processed for user `73a04115ece5418abffc9b8ea0852084`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:08:56.725140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-348c183c-58b3-4aad-a6b5-ce26b59abbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:56.789235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:56.855369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 646/1316] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:08:56.895310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54467f87-4e80-4fb6-9f90-f7c5bd1f0818 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:08:56.896928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-54467f87-4e80-4fb6-9f90-f7c5bd1f0818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:56.906729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:57.006772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54467f87-4e80-4fb6-9f90-f7c5bd1f0818 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:08:57.080254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8d772-97b7-40db-9258-e987857d7ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:08:57.080816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8d772-97b7-40db-9258-e987857d7ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:57.081093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8d772-97b7-40db-9258-e987857d7ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:57.081361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8d772-97b7-40db-9258-e987857d7ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:57.082995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-71f8d772-97b7-40db-9258-e987857d7ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:08:57.143288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:08:57.195537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8d772-97b7-40db-9258-e987857d7ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:08:57.197032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8d772-97b7-40db-9258-e987857d7ac1 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:08:57.216671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 671/1317] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:08:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:08:59.995708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffa72-fb5b-4ce0-bd93-a50e3cfeed35 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:08:59.996325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffa72-fb5b-4ce0-bd93-a50e3cfeed35 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:08:59.996669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffa72-fb5b-4ce0-bd93-a50e3cfeed35 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:08:59.998781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 647/1318] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:08:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:00.005115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2b3c-9aed-4b3c-8c7b-31f224e8ed4c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:00.005693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2b3c-9aed-4b3c-8c7b-31f224e8ed4c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:00.005693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2b3c-9aed-4b3c-8c7b-31f224e8ed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:00.107545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-245f2b3c-9aed-4b3c-8c7b-31f224e8ed4c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:00.108937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-245f2b3c-9aed-4b3c-8c7b-31f224e8ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:00.237449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 672/1319] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:00.308664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d55bd-0bda-4587-881d-01e216efb800 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:00.308978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d55bd-0bda-4587-881d-01e216efb800 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:00.309223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d55bd-0bda-4587-881d-01e216efb800 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:00.310622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 648/1320] 10.222.0.17 () {54 vars in 964 bytes} [Thu Jul 14 11:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:00.317239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fd532-8ef3-4246-81f9-4ad23e5ad434 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:00.317525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fd532-8ef3-4246-81f9-4ad23e5ad434 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:00.317813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fd532-8ef3-4246-81f9-4ad23e5ad434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:00.342331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:00.418718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9b7fd532-8ef3-4246-81f9-4ad23e5ad434 None None] MFA Rules not processed for user `a367d904a4a44e91862da4aea28a123b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:00.419907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9b7fd532-8ef3-4246-81f9-4ad23e5ad434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:00.509846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 673/1321] 10.222.0.17 () {58 vars in 1061 bytes} [Thu Jul 14 11:09:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:00.519805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d55bd-0bda-4587-881d-01e216efb800 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:00.521514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0c3d55bd-0bda-4587-881d-01e216efb800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:00.717932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d55bd-0bda-4587-881d-01e216efb800 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:00.832020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d308db-5626-499c-b656-9e25060cfde4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:00.832731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d308db-5626-499c-b656-9e25060cfde4 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:00.833018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d308db-5626-499c-b656-9e25060cfde4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:00.833298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d308db-5626-499c-b656-9e25060cfde4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:00.835096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-41d308db-5626-499c-b656-9e25060cfde4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:00.844792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:00.985562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d308db-5626-499c-b656-9e25060cfde4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:00.986958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d308db-5626-499c-b656-9e25060cfde4 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:01.008740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 649/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:04.673820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c47f5-56c6-4179-b1a4-9c6844fc3e91 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:04.674625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c47f5-56c6-4179-b1a4-9c6844fc3e91 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:04.674625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c47f5-56c6-4179-b1a4-9c6844fc3e91 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:04.675803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 674/1323] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:09:04.682430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83ea4-4aa6-428e-937e-53a0dfc1189b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:04.683233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83ea4-4aa6-428e-937e-53a0dfc1189b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:04.683233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d83ea4-4aa6-428e-937e-53a0dfc1189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:04.762253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e8d83ea4-4aa6-428e-937e-53a0dfc1189b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:04.763531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e8d83ea4-4aa6-428e-937e-53a0dfc1189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:04.851461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:04.909683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 650/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:09:04.950454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c47f5-56c6-4179-b1a4-9c6844fc3e91 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:04.953304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-428c47f5-56c6-4179-b1a4-9c6844fc3e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:05.123531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c47f5-56c6-4179-b1a4-9c6844fc3e91 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:05.142829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:05.244138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c57bc-2b17-4f19-91a3-b1ab4f281ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:05.245123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c57bc-2b17-4f19-91a3-b1ab4f281ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:05.245527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c57bc-2b17-4f19-91a3-b1ab4f281ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:05.245891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c57bc-2b17-4f19-91a3-b1ab4f281ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:05.247869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d32c57bc-2b17-4f19-91a3-b1ab4f281ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:05.454622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c57bc-2b17-4f19-91a3-b1ab4f281ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:05.457652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c57bc-2b17-4f19-91a3-b1ab4f281ca1 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:05.498631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 675/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:07.971163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7f10-6c11-4515-9776-b5c845228551 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:07.971714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7f10-6c11-4515-9776-b5c845228551 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:07.971714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e7f10-6c11-4515-9776-b5c845228551 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:07.974315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 651/1326] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:07.983214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af592b7-334e-4f83-862e-9a275a54e9df None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:07.984014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af592b7-334e-4f83-862e-9a275a54e9df None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:07.984014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af592b7-334e-4f83-862e-9a275a54e9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:08.035848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:08.059442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4af592b7-334e-4f83-862e-9a275a54e9df None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:08.060887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4af592b7-334e-4f83-862e-9a275a54e9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:08.191470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 676/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:08.236709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e7f10-6c11-4515-9776-b5c845228551 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:08.238850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-032e7f10-6c11-4515-9776-b5c845228551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:08.414096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e7f10-6c11-4515-9776-b5c845228551 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:08.551918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fe3a9-d281-45b6-8451-c0877f49de30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:08.552634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe3a9-d281-45b6-8451-c0877f49de30 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:08.552928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe3a9-d281-45b6-8451-c0877f49de30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:08.553204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe3a9-d281-45b6-8451-c0877f49de30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:08.555672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-873fe3a9-d281-45b6-8451-c0877f49de30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:08.576195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:08.699211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fe3a9-d281-45b6-8451-c0877f49de30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:08.701550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fe3a9-d281-45b6-8451-c0877f49de30 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:08.723266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 652/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:11.037751 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c794386-63bd-4eeb-8093-9b2f7275044f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:11.038308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c794386-63bd-4eeb-8093-9b2f7275044f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:11.038308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c794386-63bd-4eeb-8093-9b2f7275044f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:11.040227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 677/1329] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:11.045610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add85fd-99d3-48d9-a128-a2627ce8fa79 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:11.046075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add85fd-99d3-48d9-a128-a2627ce8fa79 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:11.046239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add85fd-99d3-48d9-a128-a2627ce8fa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:11.120653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8add85fd-99d3-48d9-a128-a2627ce8fa79 None None] MFA Rules not processed for user `73a04115ece5418abffc9b8ea0852084`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:11.121877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8add85fd-99d3-48d9-a128-a2627ce8fa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:11.198550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:11.235667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 653/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:11.272773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c794386-63bd-4eeb-8093-9b2f7275044f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:11.275431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2c794386-63bd-4eeb-8093-9b2f7275044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:11.380559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c794386-63bd-4eeb-8093-9b2f7275044f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:11.401916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:11.456152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ce24f-a7c4-4602-b89a-5093aea89a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:11.456802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ce24f-a7c4-4602-b89a-5093aea89a5c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:11.457087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ce24f-a7c4-4602-b89a-5093aea89a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:11.457367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ce24f-a7c4-4602-b89a-5093aea89a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:11.459111 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3d3ce24f-a7c4-4602-b89a-5093aea89a5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:11.618967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ce24f-a7c4-4602-b89a-5093aea89a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:11.620471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ce24f-a7c4-4602-b89a-5093aea89a5c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:11.647813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 678/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:14.077644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dfee7-a4dc-4575-ac97-15240266ad20 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:14.078170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dfee7-a4dc-4575-ac97-15240266ad20 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:14.078170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dfee7-a4dc-4575-ac97-15240266ad20 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:14.079553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 654/1332] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:14.085294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e80ab8-7c6f-493d-acfc-4254a29ee712 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:14.085966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e80ab8-7c6f-493d-acfc-4254a29ee712 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:14.085966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e80ab8-7c6f-493d-acfc-4254a29ee712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:14.155331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:14.158855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-34e80ab8-7c6f-493d-acfc-4254a29ee712 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:14.160480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-34e80ab8-7c6f-493d-acfc-4254a29ee712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:14.274762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 679/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:14.313148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dfee7-a4dc-4575-ac97-15240266ad20 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:14.314679 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6f0dfee7-a4dc-4575-ac97-15240266ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:14.433642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dfee7-a4dc-4575-ac97-15240266ad20 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:14.515397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59956f-0af1-4a83-b4c0-b5d88d95ab7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:14.516060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59956f-0af1-4a83-b4c0-b5d88d95ab7b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:14.516373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59956f-0af1-4a83-b4c0-b5d88d95ab7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:14.516651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59956f-0af1-4a83-b4c0-b5d88d95ab7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:14.518394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bb59956f-0af1-4a83-b4c0-b5d88d95ab7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:14.549555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:14.647399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59956f-0af1-4a83-b4c0-b5d88d95ab7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:14.648937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59956f-0af1-4a83-b4c0-b5d88d95ab7b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:14.669540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 655/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:16.852186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10b3e-5b87-4c80-8ecf-10ebf013371e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:16.852789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10b3e-5b87-4c80-8ecf-10ebf013371e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:16.852789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10b3e-5b87-4c80-8ecf-10ebf013371e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:16.854206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 680/1335] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:16.860729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bccb4-1f4d-442e-8bcf-2eaeddf47f58 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:16.861541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bccb4-1f4d-442e-8bcf-2eaeddf47f58 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:16.861703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bccb4-1f4d-442e-8bcf-2eaeddf47f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:16.952023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-017bccb4-1f4d-442e-8bcf-2eaeddf47f58 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:16.954222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-017bccb4-1f4d-442e-8bcf-2eaeddf47f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:17.093728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:17.121208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 656/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:17.162425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e10b3e-5b87-4c80-8ecf-10ebf013371e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:17.164679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-34e10b3e-5b87-4c80-8ecf-10ebf013371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:17.298977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e10b3e-5b87-4c80-8ecf-10ebf013371e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:17.330686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:17.377373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca618b8-61fd-47aa-8461-a59338b24a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:17.377958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca618b8-61fd-47aa-8461-a59338b24a2c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:17.378248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca618b8-61fd-47aa-8461-a59338b24a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:17.378530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca618b8-61fd-47aa-8461-a59338b24a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:17.380374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6ca618b8-61fd-47aa-8461-a59338b24a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:17.496277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca618b8-61fd-47aa-8461-a59338b24a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:17.497973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca618b8-61fd-47aa-8461-a59338b24a2c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:17.520081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 681/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:20.109663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8544e39-836a-40fe-9cc1-05378be56562 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:20.110278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8544e39-836a-40fe-9cc1-05378be56562 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:20.110392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8544e39-836a-40fe-9cc1-05378be56562 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:20.112048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 657/1338] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:20.119384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8eea-ceab-4afa-847b-2aabef3f132d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:20.120093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8eea-ceab-4afa-847b-2aabef3f132d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:20.120093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8eea-ceab-4afa-847b-2aabef3f132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:20.186109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a1fb8eea-ceab-4afa-847b-2aabef3f132d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:20.187357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a1fb8eea-ceab-4afa-847b-2aabef3f132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:20.196405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:20.302546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 682/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:09:20.343385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8544e39-836a-40fe-9cc1-05378be56562 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:20.344961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a8544e39-836a-40fe-9cc1-05378be56562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:20.449935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8544e39-836a-40fe-9cc1-05378be56562 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:20.524136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1880089-5b4e-43a5-97b2-2a710793d311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:20.524797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880089-5b4e-43a5-97b2-2a710793d311 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:20.525075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880089-5b4e-43a5-97b2-2a710793d311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:20.525349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1880089-5b4e-43a5-97b2-2a710793d311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:20.527008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d1880089-5b4e-43a5-97b2-2a710793d311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:20.563384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:20.648243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1880089-5b4e-43a5-97b2-2a710793d311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:20.651335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1880089-5b4e-43a5-97b2-2a710793d311 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:20.673709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 658/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:24.973195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e7c1-da6b-477c-aa54-d8e4cae08b5f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.974143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e7c1-da6b-477c-aa54-d8e4cae08b5f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.974143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e7c1-da6b-477c-aa54-d8e4cae08b5f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:24.975742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 683/1341] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:24.981849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865d886-9b89-4d97-9276-371e6f110b3b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:24.982751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865d886-9b89-4d97-9276-371e6f110b3b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:24.982751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865d886-9b89-4d97-9276-371e6f110b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.063660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9865d886-9b89-4d97-9276-371e6f110b3b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:25.064986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9865d886-9b89-4d97-9276-371e6f110b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:25.190988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:25.209171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 659/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:09:25.256280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e7c1-da6b-477c-aa54-d8e4cae08b5f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:25.258191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bd32e7c1-da6b-477c-aa54-d8e4cae08b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:25.379360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e7c1-da6b-477c-aa54-d8e4cae08b5f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:25.423907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:25.467679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb8a53-a050-414e-9019-f797ce741695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:25.468284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb8a53-a050-414e-9019-f797ce741695 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:25.468563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb8a53-a050-414e-9019-f797ce741695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:25.468845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb8a53-a050-414e-9019-f797ce741695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:25.470571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3ebb8a53-a050-414e-9019-f797ce741695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:25.615779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb8a53-a050-414e-9019-f797ce741695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:25.617864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb8a53-a050-414e-9019-f797ce741695 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:25.639568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 684/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:29.437888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5189-a99f-41bb-9e70-64edce1e2b63 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:29.438897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5189-a99f-41bb-9e70-64edce1e2b63 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:29.438897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5189-a99f-41bb-9e70-64edce1e2b63 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:29.439879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 660/1344] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:29.446950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a656c-d70c-490c-a3cb-643bf57e5efd None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:29.447549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a656c-d70c-490c-a3cb-643bf57e5efd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:29.447549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a656c-d70c-490c-a3cb-643bf57e5efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:29.552483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-040a656c-d70c-490c-a3cb-643bf57e5efd None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:29.554034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-040a656c-d70c-490c-a3cb-643bf57e5efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:29.579725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:29.690166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 685/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:29.731111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea5189-a99f-41bb-9e70-64edce1e2b63 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:29.734941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9dea5189-a99f-41bb-9e70-64edce1e2b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:29.886646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea5189-a99f-41bb-9e70-64edce1e2b63 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:29.990090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e638f6-2df5-436a-8f51-4bc2e29aed8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:29.991162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e638f6-2df5-436a-8f51-4bc2e29aed8c service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:29.991668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e638f6-2df5-436a-8f51-4bc2e29aed8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:29.992208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e638f6-2df5-436a-8f51-4bc2e29aed8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:29.995559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-26e638f6-2df5-436a-8f51-4bc2e29aed8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:30.086179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:30.181232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e638f6-2df5-436a-8f51-4bc2e29aed8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:30.182714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e638f6-2df5-436a-8f51-4bc2e29aed8c service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:30.204834 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 661/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:34.892848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19b36-8900-4d9b-8baa-8cfbe94faad2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:34.893648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19b36-8900-4d9b-8baa-8cfbe94faad2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:34.893648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf19b36-8900-4d9b-8baa-8cfbe94faad2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:34.895172 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 686/1347] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:34.904442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a0b5-f23c-417d-bd6e-bdb8062e0c33 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:34.905034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a0b5-f23c-417d-bd6e-bdb8062e0c33 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:34.905433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a0b5-f23c-417d-bd6e-bdb8062e0c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:35.013789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fe51a0b5-f23c-417d-bd6e-bdb8062e0c33 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:35.014951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fe51a0b5-f23c-417d-bd6e-bdb8062e0c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:35.140387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:35.144061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 662/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:35.201821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf19b36-8900-4d9b-8baa-8cfbe94faad2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:35.203723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bbf19b36-8900-4d9b-8baa-8cfbe94faad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:35.372289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf19b36-8900-4d9b-8baa-8cfbe94faad2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:35.432405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:35.468791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb23b2-1f1c-49a9-a5c1-54487972b8d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:35.469557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb23b2-1f1c-49a9-a5c1-54487972b8d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:35.469841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb23b2-1f1c-49a9-a5c1-54487972b8d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:35.470117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb23b2-1f1c-49a9-a5c1-54487972b8d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:35.471917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f4eb23b2-1f1c-49a9-a5c1-54487972b8d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:35.640547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb23b2-1f1c-49a9-a5c1-54487972b8d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:35.642088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb23b2-1f1c-49a9-a5c1-54487972b8d3 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:35.667102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 687/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:41.526463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993465a-8cd1-4938-8a2a-5f0dd6d7804a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:41.527349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993465a-8cd1-4938-8a2a-5f0dd6d7804a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:41.527774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993465a-8cd1-4938-8a2a-5f0dd6d7804a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:41.529772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 663/1350] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:41.536908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149463e8-9232-4091-bf0d-698104dab2a4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:41.537708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149463e8-9232-4091-bf0d-698104dab2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:41.539908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149463e8-9232-4091-bf0d-698104dab2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:41.644426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-149463e8-9232-4091-bf0d-698104dab2a4 None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:41.645820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-149463e8-9232-4091-bf0d-698104dab2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:41.715107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:41.858347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 688/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:09:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:46.096698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc1c5-861f-4b42-ad45-109f2c0582af None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:46.097650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc1c5-861f-4b42-ad45-109f2c0582af None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:46.097650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cc1c5-861f-4b42-ad45-109f2c0582af None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:46.100584 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 664/1352] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:09:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:46.107133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ff197-7da6-41e4-8cf8-b75739705cdf None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:46.108357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ff197-7da6-41e4-8cf8-b75739705cdf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:46.108906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ff197-7da6-41e4-8cf8-b75739705cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:46.221595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-297ff197-7da6-41e4-8cf8-b75739705cdf None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:46.222860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-297ff197-7da6-41e4-8cf8-b75739705cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:46.347793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:46.396453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 689/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:09:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:47.909997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d4c1c-2733-4f92-8439-4be90df4df70 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:47.910672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d4c1c-2733-4f92-8439-4be90df4df70 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:47.910672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d4c1c-2733-4f92-8439-4be90df4df70 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:47.911912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 665/1354] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:47.917867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dd6b0-c653-417e-962f-dc91119331bf None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:47.918374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dd6b0-c653-417e-962f-dc91119331bf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:47.918682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dd6b0-c653-417e-962f-dc91119331bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:47.993732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-320dd6b0-c653-417e-962f-dc91119331bf None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:47.994934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-320dd6b0-c653-417e-962f-dc91119331bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:48.099456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 690/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:09:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:51.767269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc9f00-f78e-41f0-903c-916eb2ec2238 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:51.767805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc9f00-f78e-41f0-903c-916eb2ec2238 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:51.767805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc9f00-f78e-41f0-903c-916eb2ec2238 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:51.769209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 666/1356] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:51.775034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071f80-4a4f-41c4-a362-b5e935991617 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:51.775528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071f80-4a4f-41c4-a362-b5e935991617 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:51.775796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff071f80-4a4f-41c4-a362-b5e935991617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:51.831376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:51.895165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ff071f80-4a4f-41c4-a362-b5e935991617 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:51.896458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ff071f80-4a4f-41c4-a362-b5e935991617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:52.033431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 691/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:52.090431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b236cd-8fff-4e26-8dec-1651921a5a25 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:52.090743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b236cd-8fff-4e26-8dec-1651921a5a25 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:52.091002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b236cd-8fff-4e26-8dec-1651921a5a25 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:52.092397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 667/1358] 10.222.0.17 () {54 vars in 961 bytes} [Thu Jul 14 11:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:52.101895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3c2a5-d2d8-4076-8376-36efefad7633 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:52.102181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3c2a5-d2d8-4076-8376-36efefad7633 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:52.102467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3c2a5-d2d8-4076-8376-36efefad7633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:52.192909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3aa3c2a5-d2d8-4076-8376-36efefad7633 None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:52.194123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3aa3c2a5-d2d8-4076-8376-36efefad7633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:52.276571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:52.371357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 692/1359] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Jul 14 11:09:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:52.380565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b236cd-8fff-4e26-8dec-1651921a5a25 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:52.383077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-45b236cd-8fff-4e26-8dec-1651921a5a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:52.593457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b236cd-8fff-4e26-8dec-1651921a5a25 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:52.685836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:52.734742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c7900-e9f5-4e0e-a890-b141226802c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:52.735728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c7900-e9f5-4e0e-a890-b141226802c5 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:52.736134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c7900-e9f5-4e0e-a890-b141226802c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:52.736501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c7900-e9f5-4e0e-a890-b141226802c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:52.738266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-037c7900-e9f5-4e0e-a890-b141226802c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:52.873129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c7900-e9f5-4e0e-a890-b141226802c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:52.874822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c7900-e9f5-4e0e-a890-b141226802c5 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:52.894798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 668/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:55.198606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90753e4-8771-4810-8762-a532d0304ee1 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:55.199158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90753e4-8771-4810-8762-a532d0304ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:55.199158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90753e4-8771-4810-8762-a532d0304ee1 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:55.200666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 693/1361] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:55.205746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1a16-3f5b-40bb-b21f-17c0e1f11ea2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:55.206171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1a16-3f5b-40bb-b21f-17c0e1f11ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:55.206250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1a16-3f5b-40bb-b21f-17c0e1f11ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:55.276162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ff7c1a16-3f5b-40bb-b21f-17c0e1f11ea2 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:55.277939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ff7c1a16-3f5b-40bb-b21f-17c0e1f11ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:55.322213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:55.396308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 669/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:55.442686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90753e4-8771-4810-8762-a532d0304ee1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:55.444225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b90753e4-8771-4810-8762-a532d0304ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:55.595540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90753e4-8771-4810-8762-a532d0304ee1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:55.605549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:55.723451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b78d4e-4257-4894-be21-3911e0023e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:55.724117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b78d4e-4257-4894-be21-3911e0023e71 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:55.724411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b78d4e-4257-4894-be21-3911e0023e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:55.724686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b78d4e-4257-4894-be21-3911e0023e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:55.726382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-74b78d4e-4257-4894-be21-3911e0023e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:55.842081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b78d4e-4257-4894-be21-3911e0023e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:55.844180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b78d4e-4257-4894-be21-3911e0023e71 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:55.869431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 694/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:09:58.306584 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdbfe7-be46-4a93-a81f-af29ddf7b393 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:58.307130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdbfe7-be46-4a93-a81f-af29ddf7b393 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:58.307130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdbfe7-be46-4a93-a81f-af29ddf7b393 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:58.309136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 670/1364] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:58.314485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33d54-1b4d-40f1-9764-512553778a20 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:58.315170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33d54-1b4d-40f1-9764-512553778a20 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:58.315170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33d54-1b4d-40f1-9764-512553778a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:58.336497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:58.392997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4ef33d54-1b4d-40f1-9764-512553778a20 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:58.394411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4ef33d54-1b4d-40f1-9764-512553778a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:58.506515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 695/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:58.554886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c821-dfac-4913-a862-3fbfad80d2ae None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:58.555169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c821-dfac-4913-a862-3fbfad80d2ae None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:58.555444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c821-dfac-4913-a862-3fbfad80d2ae None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:58.557393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 671/1366] 10.222.0.17 () {54 vars in 961 bytes} [Thu Jul 14 11:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:09:58.562802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eeac3-5fd6-4d1d-9d86-4f9c3e57d29c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:58.563127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eeac3-5fd6-4d1d-9d86-4f9c3e57d29c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:58.563419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eeac3-5fd6-4d1d-9d86-4f9c3e57d29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:58.644476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bb5eeac3-5fd6-4d1d-9d86-4f9c3e57d29c None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:09:58.645798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bb5eeac3-5fd6-4d1d-9d86-4f9c3e57d29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:58.682745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:58.774469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 696/1367] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Jul 14 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:09:58.783510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c821-dfac-4913-a862-3fbfad80d2ae None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:09:58.785204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5497c821-dfac-4913-a862-3fbfad80d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:58.942382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c821-dfac-4913-a862-3fbfad80d2ae None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:09:58.964056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:09:59.063622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28b449-5582-4899-b95b-0a453b3ad758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:09:59.064396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b449-5582-4899-b95b-0a453b3ad758 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:09:59.064744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b449-5582-4899-b95b-0a453b3ad758 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:09:59.065083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28b449-5582-4899-b95b-0a453b3ad758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:09:59.066789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-af28b449-5582-4899-b95b-0a453b3ad758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:09:59.162687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28b449-5582-4899-b95b-0a453b3ad758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:09:59.165006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28b449-5582-4899-b95b-0a453b3ad758 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:09:59.184758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 672/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:00.185469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafebd15-5112-4862-9a03-d551ef1ad5b9 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:00.186019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafebd15-5112-4862-9a03-d551ef1ad5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:00.186019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafebd15-5112-4862-9a03-d551ef1ad5b9 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:00.187611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 697/1369] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:00.192799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75249-cb57-41d0-a0da-3fbe7841c09c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:00.193292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75249-cb57-41d0-a0da-3fbe7841c09c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:00.193375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75249-cb57-41d0-a0da-3fbe7841c09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:00.229971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:00.265299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6df75249-cb57-41d0-a0da-3fbe7841c09c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:00.266515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6df75249-cb57-41d0-a0da-3fbe7841c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:00.372946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 673/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:00.749203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d7f6-ab6b-4870-acab-d10ac20a95bf None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:00.749203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d7f6-ab6b-4870-acab-d10ac20a95bf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:00.749203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291d7f6-ab6b-4870-acab-d10ac20a95bf None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:00.749203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 698/1371] 10.222.0.17 () {54 vars in 963 bytes} [Thu Jul 14 11:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:00.755218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebb2f-ca2a-4380-875b-b8c8d719fd88 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:00.755218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebb2f-ca2a-4380-875b-b8c8d719fd88 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:00.755218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ebb2f-ca2a-4380-875b-b8c8d719fd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:00.844287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7c4ebb2f-ca2a-4380-875b-b8c8d719fd88 None None] MFA Rules not processed for user `c46f7ca6d48c4124a9af1dc3a74c37a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:00.845515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7c4ebb2f-ca2a-4380-875b-b8c8d719fd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:00.896342 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:00.929815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 674/1372] 10.222.0.17 () {58 vars in 1060 bytes} [Thu Jul 14 11:10:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:00.937400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291d7f6-ab6b-4870-acab-d10ac20a95bf None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:00.939577 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c291d7f6-ab6b-4870-acab-d10ac20a95bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:01.064852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291d7f6-ab6b-4870-acab-d10ac20a95bf None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:01.109422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:01.144937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9801212-c31f-4d1f-a5a9-891a0559e552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:01.145597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801212-c31f-4d1f-a5a9-891a0559e552 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:01.145880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801212-c31f-4d1f-a5a9-891a0559e552 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:01.146159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9801212-c31f-4d1f-a5a9-891a0559e552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:01.148464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e9801212-c31f-4d1f-a5a9-891a0559e552 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:01.265763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9801212-c31f-4d1f-a5a9-891a0559e552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:01.267237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9801212-c31f-4d1f-a5a9-891a0559e552 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:01.287845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 699/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:10:01.332823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6358c-12d3-4d09-ab11-541718152025 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:01.333243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6358c-12d3-4d09-ab11-541718152025 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:01.333243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6358c-12d3-4d09-ab11-541718152025 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:01.336759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 675/1374] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:01.343802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37863b9-d2d0-412a-be57-c13d0991f5ce None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:01.345353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37863b9-d2d0-412a-be57-c13d0991f5ce None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:01.345995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37863b9-d2d0-412a-be57-c13d0991f5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:01.419142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f37863b9-d2d0-412a-be57-c13d0991f5ce None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:01.420515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f37863b9-d2d0-412a-be57-c13d0991f5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:01.443189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:01.561510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 700/1375] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:01.605248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6358c-12d3-4d09-ab11-541718152025 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:01.606814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e5c6358c-12d3-4d09-ab11-541718152025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:01.808505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6358c-12d3-4d09-ab11-541718152025 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:01.879167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:01.951111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212aeea-e93e-4bc5-8ee6-0b657a8eee95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:01.951755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212aeea-e93e-4bc5-8ee6-0b657a8eee95 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:01.952038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212aeea-e93e-4bc5-8ee6-0b657a8eee95 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:01.952344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212aeea-e93e-4bc5-8ee6-0b657a8eee95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:01.954407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7212aeea-e93e-4bc5-8ee6-0b657a8eee95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:02.078534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212aeea-e93e-4bc5-8ee6-0b657a8eee95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:02.080207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212aeea-e93e-4bc5-8ee6-0b657a8eee95 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:02.099195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 676/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:04.205155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931207-92d7-4870-b57c-c56563c2f2b8 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:04.205791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931207-92d7-4870-b57c-c56563c2f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:04.205791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2931207-92d7-4870-b57c-c56563c2f2b8 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:04.207005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 701/1377] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:04.213597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c7b08-cace-414d-b31e-d8d813dd22d6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:04.214310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c7b08-cace-414d-b31e-d8d813dd22d6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:04.214310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c7b08-cace-414d-b31e-d8d813dd22d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:04.288802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cd2c7b08-cace-414d-b31e-d8d813dd22d6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:04.290055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cd2c7b08-cace-414d-b31e-d8d813dd22d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:04.297695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:04.394041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 677/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:04.439036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931207-92d7-4870-b57c-c56563c2f2b8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:04.440660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f2931207-92d7-4870-b57c-c56563c2f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:04.624231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2931207-92d7-4870-b57c-c56563c2f2b8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:04.628032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:04.745858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfc200-be35-44b8-bebe-3491ab8ff1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:04.746542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfc200-be35-44b8-bebe-3491ab8ff1f9 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:04.746848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfc200-be35-44b8-bebe-3491ab8ff1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:04.747167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfc200-be35-44b8-bebe-3491ab8ff1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:04.748933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c6cfc200-be35-44b8-bebe-3491ab8ff1f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:04.849319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfc200-be35-44b8-bebe-3491ab8ff1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:04.850998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfc200-be35-44b8-bebe-3491ab8ff1f9 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:04.869778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 702/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:07.000432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28198f-f459-4d80-b776-31c9ec298f53 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:07.000918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28198f-f459-4d80-b776-31c9ec298f53 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:07.001003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28198f-f459-4d80-b776-31c9ec298f53 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:07.002492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 678/1380] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:07.007523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5caa4-de8c-41a7-a091-540df4818ebd None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:07.007933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5caa4-de8c-41a7-a091-540df4818ebd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:07.008150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5caa4-de8c-41a7-a091-540df4818ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:07.018128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:07.079265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-67b5caa4-de8c-41a7-a091-540df4818ebd None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:07.080488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-67b5caa4-de8c-41a7-a091-540df4818ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:07.194859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 703/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:07.239892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28198f-f459-4d80-b776-31c9ec298f53 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:07.243390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fe28198f-f459-4d80-b776-31c9ec298f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:07.407547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:07.421284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28198f-f459-4d80-b776-31c9ec298f53 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:07.595123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69168e-de9b-4a0f-934f-d15badaefcaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:07.597180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69168e-de9b-4a0f-934f-d15badaefcaa service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:07.597180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69168e-de9b-4a0f-934f-d15badaefcaa service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:07.597180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69168e-de9b-4a0f-934f-d15badaefcaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:07.598124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8e69168e-de9b-4a0f-934f-d15badaefcaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:07.743984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69168e-de9b-4a0f-934f-d15badaefcaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:07.745564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69168e-de9b-4a0f-934f-d15badaefcaa service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:07.761869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:07.771283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 679/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:09.917232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571dce-c070-4134-aa49-5b10f8fead56 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:09.917765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571dce-c070-4134-aa49-5b10f8fead56 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:09.917889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571dce-c070-4134-aa49-5b10f8fead56 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:09.919343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 704/1383] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:09.925030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce676747-4727-4d7f-9aa8-58d91dd30e9d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:09.925556 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce676747-4727-4d7f-9aa8-58d91dd30e9d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:09.925556 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce676747-4727-4d7f-9aa8-58d91dd30e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:10.002896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ce676747-4727-4d7f-9aa8-58d91dd30e9d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:10.004211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ce676747-4727-4d7f-9aa8-58d91dd30e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:10.152927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 680/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:10:10.208558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89571dce-c070-4134-aa49-5b10f8fead56 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:10.210746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-89571dce-c070-4134-aa49-5b10f8fead56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:10.335276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:10.432458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89571dce-c070-4134-aa49-5b10f8fead56 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:10.626082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0b492-21d4-49f2-8f02-745bcda4135e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:10.626750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b492-21d4-49f2-8f02-745bcda4135e service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:10.627034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b492-21d4-49f2-8f02-745bcda4135e service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:10.627347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b492-21d4-49f2-8f02-745bcda4135e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:10.629107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7da0b492-21d4-49f2-8f02-745bcda4135e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:10.686117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:10.748816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0b492-21d4-49f2-8f02-745bcda4135e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:10.752540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0b492-21d4-49f2-8f02-745bcda4135e service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:10.792349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 705/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:12.983411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b644-b828-4c72-b99f-c77d80486e0a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:12.984625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b644-b828-4c72-b99f-c77d80486e0a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:12.984625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355b644-b828-4c72-b99f-c77d80486e0a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:12.986409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 681/1386] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:12.994204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f517-1c0b-4338-87b4-2a8aaf414b04 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:12.995275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f517-1c0b-4338-87b4-2a8aaf414b04 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:12.995275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f517-1c0b-4338-87b4-2a8aaf414b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:13.093351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f1b7f517-1c0b-4338-87b4-2a8aaf414b04 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:13.094618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f1b7f517-1c0b-4338-87b4-2a8aaf414b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:13.242918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 706/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:10:13.289924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355b644-b828-4c72-b99f-c77d80486e0a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:13.291889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7355b644-b828-4c72-b99f-c77d80486e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:13.425173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:13.576716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355b644-b828-4c72-b99f-c77d80486e0a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:13.774806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9471a-32d3-4c52-b8f0-614c56bb570a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:13.775552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9471a-32d3-4c52-b8f0-614c56bb570a service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:13.776140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9471a-32d3-4c52-b8f0-614c56bb570a service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:13.776412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9471a-32d3-4c52-b8f0-614c56bb570a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:13.778853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0ac9471a-32d3-4c52-b8f0-614c56bb570a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:13.829469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:13.893104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9471a-32d3-4c52-b8f0-614c56bb570a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:13.896023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9471a-32d3-4c52-b8f0-614c56bb570a service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:13.931480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 682/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:10:16.153537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395e79-02f6-43ae-81f1-6ecc4a41a3fc None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:16.154386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395e79-02f6-43ae-81f1-6ecc4a41a3fc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:16.154572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21395e79-02f6-43ae-81f1-6ecc4a41a3fc None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:16.156430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 707/1389] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:16.162267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d4c8-cf7d-4462-b4a0-8f6bb2c2c3e8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:16.163175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d4c8-cf7d-4462-b4a0-8f6bb2c2c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:16.163175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20d4c8-cf7d-4462-b4a0-8f6bb2c2c3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:16.235663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-de20d4c8-cf7d-4462-b4a0-8f6bb2c2c3e8 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:16.236957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-de20d4c8-cf7d-4462-b4a0-8f6bb2c2c3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:16.335148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 683/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:16.379281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21395e79-02f6-43ae-81f1-6ecc4a41a3fc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:16.380887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-21395e79-02f6-43ae-81f1-6ecc4a41a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:16.422575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:16.560884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21395e79-02f6-43ae-81f1-6ecc4a41a3fc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:16.673708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:16.686319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cb318-286b-4ab6-8c3b-27cbaa607193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:16.686984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb318-286b-4ab6-8c3b-27cbaa607193 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:16.687273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb318-286b-4ab6-8c3b-27cbaa607193 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:16.687554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cb318-286b-4ab6-8c3b-27cbaa607193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:16.689271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-729cb318-286b-4ab6-8c3b-27cbaa607193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:16.782759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cb318-286b-4ab6-8c3b-27cbaa607193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:16.784429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cb318-286b-4ab6-8c3b-27cbaa607193 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:16.818341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 708/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:16.861414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4fd4a-62f3-4ad0-8a0f-402390742d71 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:16.861809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4fd4a-62f3-4ad0-8a0f-402390742d71 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:16.862003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4fd4a-62f3-4ad0-8a0f-402390742d71 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:16.863423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 684/1392] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:16.879505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde8b-34ce-4d52-80cd-6939db81412c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:16.879801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde8b-34ce-4d52-80cd-6939db81412c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:16.880076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde8b-34ce-4d52-80cd-6939db81412c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:16.961157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8e3bde8b-34ce-4d52-80cd-6939db81412c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:16.962442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8e3bde8b-34ce-4d52-80cd-6939db81412c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:17.059577 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:17.104428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 709/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:17.160927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ca98-db62-4120-bed6-deb00b006373 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:17.161299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ca98-db62-4120-bed6-deb00b006373 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:17.161494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ca98-db62-4120-bed6-deb00b006373 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:17.163125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 685/1394] 10.222.0.17 () {54 vars in 962 bytes} [Thu Jul 14 11:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:10:17.169028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825bef-0861-4989-8bff-f05d9922f688 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:17.169540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825bef-0861-4989-8bff-f05d9922f688 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:17.169737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825bef-0861-4989-8bff-f05d9922f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:17.260769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-98825bef-0861-4989-8bff-f05d9922f688 None None] MFA Rules not processed for user `4c97bd14230147a5bd004c71f5387098`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:17.261905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-98825bef-0861-4989-8bff-f05d9922f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:17.343984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 710/1395] 10.222.0.17 () {58 vars in 1059 bytes} [Thu Jul 14 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:17.351645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21ca98-db62-4120-bed6-deb00b006373 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:17.353186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3c21ca98-db62-4120-bed6-deb00b006373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:17.367578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:17.463171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21ca98-db62-4120-bed6-deb00b006373 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:17.549153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d196de-3abd-4dd8-bf61-19f53ac836ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c97bd14230147a5bd004c71f5387098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:17.549809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d196de-3abd-4dd8-bf61-19f53ac836ff service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:17.550087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d196de-3abd-4dd8-bf61-19f53ac836ff service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:17.550361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d196de-3abd-4dd8-bf61-19f53ac836ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:17.552014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-47d196de-3abd-4dd8-bf61-19f53ac836ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:17.620319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:17.663278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d196de-3abd-4dd8-bf61-19f53ac836ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:17.664764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d196de-3abd-4dd8-bf61-19f53ac836ff service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:17.682722 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 686/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:18.436943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5162-e89c-4a84-9bd5-b64aadbde443 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:18.437481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5162-e89c-4a84-9bd5-b64aadbde443 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:18.437625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5162-e89c-4a84-9bd5-b64aadbde443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:18.505052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b45d5162-e89c-4a84-9bd5-b64aadbde443 None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:18.506493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b45d5162-e89c-4a84-9bd5-b64aadbde443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:18.515444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:18.599265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 711/1397] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:10:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:18.659670 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c13d0-c763-4e9f-b5d6-2b905870e8ca None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:18.660240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c13d0-c763-4e9f-b5d6-2b905870e8ca None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:18.660240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c13d0-c763-4e9f-b5d6-2b905870e8ca None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:18.661632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 687/1398] 10.222.0.17 () {54 vars in 942 bytes} [Thu Jul 14 11:10:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:18.668779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c277-a3c3-4051-b9a3-d08732f4e506 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:18.669098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c277-a3c3-4051-b9a3-d08732f4e506 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:18.669374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c277-a3c3-4051-b9a3-d08732f4e506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:18.742378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d253c277-a3c3-4051-b9a3-d08732f4e506 None None] MFA Rules not processed for user `23cd2e48acd9491cb513274c8ce3641f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:18.743573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d253c277-a3c3-4051-b9a3-d08732f4e506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:18.825515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:18.849810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 712/1399] 10.222.0.17 () {58 vars in 1039 bytes} [Thu Jul 14 11:10:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:18.859904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c13d0-c763-4e9f-b5d6-2b905870e8ca None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:18.861444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d2c13d0-c763-4e9f-b5d6-2b905870e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:18.994352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c13d0-c763-4e9f-b5d6-2b905870e8ca None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:19.008014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f190-697a-4269-bb17-daead55a0bf8 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:19.008426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f190-697a-4269-bb17-daead55a0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:19.008817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f190-697a-4269-bb17-daead55a0bf8 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:19.010278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 713/1400] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:10:19.015403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6121e7-b20c-438a-8603-0130bb07500b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:19.015688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6121e7-b20c-438a-8603-0130bb07500b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:19.015964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6121e7-b20c-438a-8603-0130bb07500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:19.031694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:19.081168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6c6121e7-b20c-438a-8603-0130bb07500b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:19.082515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6c6121e7-b20c-438a-8603-0130bb07500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:19.103419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef2e25-c269-4148-a81a-52f3ffa6f015 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:19.104000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef2e25-c269-4148-a81a-52f3ffa6f015 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:19.104311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef2e25-c269-4148-a81a-52f3ffa6f015 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:19.104597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef2e25-c269-4148-a81a-52f3ffa6f015 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:19.106352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6fef2e25-c269-4148-a81a-52f3ffa6f015 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:19.191633 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 714/1401] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:10:19.223781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef2e25-c269-4148-a81a-52f3ffa6f015 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:19.225132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef2e25-c269-4148-a81a-52f3ffa6f015 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:19.236424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 688/1402] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:10:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:10:19.242967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6121e7-b20c-438a-8603-0130bb07500b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:19.244260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6c6121e7-b20c-438a-8603-0130bb07500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:19.316698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:19.376561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6121e7-b20c-438a-8603-0130bb07500b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:19.521222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d56b4d-5366-44cd-9ef9-13198a70dd55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:19.523203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56b4d-5366-44cd-9ef9-13198a70dd55 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:19.523490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56b4d-5366-44cd-9ef9-13198a70dd55 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:19.523771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56b4d-5366-44cd-9ef9-13198a70dd55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:19.525523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-02d56b4d-5366-44cd-9ef9-13198a70dd55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:19.598725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:19.639246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d56b4d-5366-44cd-9ef9-13198a70dd55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:19.640883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d56b4d-5366-44cd-9ef9-13198a70dd55 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:19.662147 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 715/1403] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:21.809735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb6b1-4ab5-474d-8f04-df9ea3ae46fd None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:21.810287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb6b1-4ab5-474d-8f04-df9ea3ae46fd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:21.810287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfb6b1-4ab5-474d-8f04-df9ea3ae46fd None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:21.815979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 689/1404] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:21.817642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb9ea-ff80-4c8e-be09-ba170bfff360 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:21.818433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb9ea-ff80-4c8e-be09-ba170bfff360 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:21.818782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb9ea-ff80-4c8e-be09-ba170bfff360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:21.906924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-644cb9ea-ff80-4c8e-be09-ba170bfff360 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:21.908616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-644cb9ea-ff80-4c8e-be09-ba170bfff360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:22.076913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 716/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:22.125234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb6b1-4ab5-474d-8f04-df9ea3ae46fd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:22.126879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1dbfb6b1-4ab5-474d-8f04-df9ea3ae46fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:22.213325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:22.358630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfb6b1-4ab5-474d-8f04-df9ea3ae46fd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:22.490353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c230688-3b95-40c8-8b39-703694d10121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:22.491148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c230688-3b95-40c8-8b39-703694d10121 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:22.493631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c230688-3b95-40c8-8b39-703694d10121 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:22.494009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c230688-3b95-40c8-8b39-703694d10121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:22.495990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4c230688-3b95-40c8-8b39-703694d10121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:22.533160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:22.630355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c230688-3b95-40c8-8b39-703694d10121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:22.632921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c230688-3b95-40c8-8b39-703694d10121 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:22.654975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 690/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:24.827086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53fcc-b677-430f-946f-3e0339298757 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:24.827680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53fcc-b677-430f-946f-3e0339298757 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:24.827680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb53fcc-b677-430f-946f-3e0339298757 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:24.832320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 717/1407] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:10:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:10:24.834730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5ace-867f-4da7-9560-48c29cde7148 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:24.835186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5ace-867f-4da7-9560-48c29cde7148 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:24.835278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed5ace-867f-4da7-9560-48c29cde7148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:24.918133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-23ed5ace-867f-4da7-9560-48c29cde7148 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:24.919421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-23ed5ace-867f-4da7-9560-48c29cde7148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:25.075143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 691/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:25.141266 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53fcc-b677-430f-946f-3e0339298757 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:25.142807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3fb53fcc-b677-430f-946f-3e0339298757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:25.188225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:25.367244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb53fcc-b677-430f-946f-3e0339298757 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:25.568851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:25.579072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8907a-84fd-4df4-a68e-4ad900096b07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:25.579858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8907a-84fd-4df4-a68e-4ad900096b07 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:25.580202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8907a-84fd-4df4-a68e-4ad900096b07 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:25.580441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8907a-84fd-4df4-a68e-4ad900096b07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:25.582168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-20a8907a-84fd-4df4-a68e-4ad900096b07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:25.713036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8907a-84fd-4df4-a68e-4ad900096b07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:25.714777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8907a-84fd-4df4-a68e-4ad900096b07 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:25.742506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 718/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:35.072020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:35.739854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=47 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:41.811479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9202-1c05-4816-81e8-74618ec26036 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:41.812046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9202-1c05-4816-81e8-74618ec26036 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:41.812046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9202-1c05-4816-81e8-74618ec26036 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:41.813340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 692/1410] 10.222.0.17 () {54 vars in 918 bytes} [Thu Jul 14 11:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:10:41.818581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2a3d3-efbd-43bf-bbf9-a529fabac106 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:41.818983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2a3d3-efbd-43bf-bbf9-a529fabac106 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:41.819182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2a3d3-efbd-43bf-bbf9-a529fabac106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:41.892378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0cc2a3d3-efbd-43bf-bbf9-a529fabac106 None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:41.893602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0cc2a3d3-efbd-43bf-bbf9-a529fabac106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:42.003803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 719/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Jul 14 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:42.019600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66376-c95a-4264-9af9-2afe8f6ee3b1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:42.020018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66376-c95a-4264-9af9-2afe8f6ee3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:42.020459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a66376-c95a-4264-9af9-2afe8f6ee3b1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:42.024210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 693/1412] 10.222.0.17 () {54 vars in 918 bytes} [Thu Jul 14 11:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:42.027621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78866-d18e-45d6-ba46-9a0bd377d9bd None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:42.027909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78866-d18e-45d6-ba46-9a0bd377d9bd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:42.028221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e78866-d18e-45d6-ba46-9a0bd377d9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:42.099165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:42.102179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-41e78866-d18e-45d6-ba46-9a0bd377d9bd None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:42.103890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-41e78866-d18e-45d6-ba46-9a0bd377d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:42.216996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 720/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Jul 14 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:44.757110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11bd1-fc75-431c-832b-74f925934580 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:44.757678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11bd1-fc75-431c-832b-74f925934580 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:44.757678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11bd1-fc75-431c-832b-74f925934580 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:44.759074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:44.764937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c87a-a9c0-4fcd-b3ea-8f581bb15f3a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:44.765474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c87a-a9c0-4fcd-b3ea-8f581bb15f3a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:44.765587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458c87a-a9c0-4fcd-b3ea-8f581bb15f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:44.833785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6458c87a-a9c0-4fcd-b3ea-8f581bb15f3a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:44.835008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6458c87a-a9c0-4fcd-b3ea-8f581bb15f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:44.891296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:44.935149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:44.981246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11bd1-fc75-431c-832b-74f925934580 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:44.982804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-57f11bd1-fc75-431c-832b-74f925934580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:45.127027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11bd1-fc75-431c-832b-74f925934580 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:45.205411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:45.247839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308723d-1713-4d06-9d8d-3b5affeb8114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:45.248520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308723d-1713-4d06-9d8d-3b5affeb8114 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:45.248802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308723d-1713-4d06-9d8d-3b5affeb8114 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:45.249071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308723d-1713-4d06-9d8d-3b5affeb8114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:45.250714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4308723d-1713-4d06-9d8d-3b5affeb8114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:45.338775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308723d-1713-4d06-9d8d-3b5affeb8114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:45.340408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308723d-1713-4d06-9d8d-3b5affeb8114 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:45.358997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 695/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:46.269955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad78b3-77b4-4439-bd76-e7150b1fcbe9 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:46.270475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad78b3-77b4-4439-bd76-e7150b1fcbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:46.270475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad78b3-77b4-4439-bd76-e7150b1fcbe9 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:46.271820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:46.276803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f1d0a-0c9a-45d5-81f2-7912ca604d6d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:46.277217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f1d0a-0c9a-45d5-81f2-7912ca604d6d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:46.277355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f1d0a-0c9a-45d5-81f2-7912ca604d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:46.351101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d58f1d0a-0c9a-45d5-81f2-7912ca604d6d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:46.352338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d58f1d0a-0c9a-45d5-81f2-7912ca604d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:46.379984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:46.452907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:46.603697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad78b3-77b4-4439-bd76-e7150b1fcbe9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:46.605279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c7ad78b3-77b4-4439-bd76-e7150b1fcbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:46.750661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad78b3-77b4-4439-bd76-e7150b1fcbe9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:46.790860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:46.863670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21066b1f-2d32-4e13-a282-74a9399cd300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:46.864361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21066b1f-2d32-4e13-a282-74a9399cd300 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:46.864645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21066b1f-2d32-4e13-a282-74a9399cd300 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:46.864948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21066b1f-2d32-4e13-a282-74a9399cd300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:46.867402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-21066b1f-2d32-4e13-a282-74a9399cd300 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:46.964924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21066b1f-2d32-4e13-a282-74a9399cd300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:46.966554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21066b1f-2d32-4e13-a282-74a9399cd300 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:46.985581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 723/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:47.884551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5e65-dd03-4957-9e6b-9564c09224b0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:47.885068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5e65-dd03-4957-9e6b-9564c09224b0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:47.885182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a5e65-dd03-4957-9e6b-9564c09224b0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:47.886467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:10:47.891478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710570-544c-4b60-b081-bcb913522c40 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:47.891872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710570-544c-4b60-b081-bcb913522c40 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:47.892041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710570-544c-4b60-b081-bcb913522c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:47.944911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:47.967084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-81710570-544c-4b60-b081-bcb913522c40 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:47.968355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-81710570-544c-4b60-b081-bcb913522c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:48.063012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:48.217202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5e65-dd03-4957-9e6b-9564c09224b0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:48.219566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-db2a5e65-dd03-4957-9e6b-9564c09224b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:48.366033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a5e65-dd03-4957-9e6b-9564c09224b0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:48.378084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:48.478725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c08d3f-d0c4-4731-9eec-335b34518b06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:48.479286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08d3f-d0c4-4731-9eec-335b34518b06 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:48.479570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08d3f-d0c4-4731-9eec-335b34518b06 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:48.479847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08d3f-d0c4-4731-9eec-335b34518b06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:48.481526 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-40c08d3f-d0c4-4731-9eec-335b34518b06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:48.579676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08d3f-d0c4-4731-9eec-335b34518b06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:48.581340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08d3f-d0c4-4731-9eec-335b34518b06 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:48.599051 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 698/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:49.490006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85016661-debb-4ed5-935a-a8f968ab13b8 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:49.491104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85016661-debb-4ed5-935a-a8f968ab13b8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:49.491219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85016661-debb-4ed5-935a-a8f968ab13b8 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:49.492688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:49.497596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a1c9-f951-4c3e-8964-cf6fcba2334b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:49.497989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a1c9-f951-4c3e-8964-cf6fcba2334b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:49.498139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7a1c9-f951-4c3e-8964-cf6fcba2334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:49.516223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:49.573462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-70b7a1c9-f951-4c3e-8964-cf6fcba2334b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:49.574664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-70b7a1c9-f951-4c3e-8964-cf6fcba2334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:49.669834 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:49.819626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85016661-debb-4ed5-935a-a8f968ab13b8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:49.821368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-85016661-debb-4ed5-935a-a8f968ab13b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:49.931585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:50.085651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85016661-debb-4ed5-935a-a8f968ab13b8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:50.194034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf05e56-29ac-49b2-a89d-e885e85e3bb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:50.194706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05e56-29ac-49b2-a89d-e885e85e3bb7 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:50.194980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05e56-29ac-49b2-a89d-e885e85e3bb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:50.195256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf05e56-29ac-49b2-a89d-e885e85e3bb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:50.197250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1cf05e56-29ac-49b2-a89d-e885e85e3bb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:50.273184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:50.286647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf05e56-29ac-49b2-a89d-e885e85e3bb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:50.288889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf05e56-29ac-49b2-a89d-e885e85e3bb7 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:50.306324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 726/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:51.169583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd483-5a04-4b0f-8882-53b77b8cdac8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:51.170097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd483-5a04-4b0f-8882-53b77b8cdac8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:51.170097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fd483-5a04-4b0f-8882-53b77b8cdac8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:51.171421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:51.176358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4145-4f9f-44af-8c4e-b4ca03ce2464 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:51.176750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4145-4f9f-44af-8c4e-b4ca03ce2464 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:51.176909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4145-4f9f-44af-8c4e-b4ca03ce2464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:51.251981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-31ab4145-4f9f-44af-8c4e-b4ca03ce2464 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:51.253219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-31ab4145-4f9f-44af-8c4e-b4ca03ce2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:51.347082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:51.499645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fd483-5a04-4b0f-8882-53b77b8cdac8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:51.501191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e07fd483-5a04-4b0f-8882-53b77b8cdac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:51.584428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:51.646197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fd483-5a04-4b0f-8882-53b77b8cdac8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:51.758138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9d958-089f-4bdd-a9b6-42a4091b02e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:51.758713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9d958-089f-4bdd-a9b6-42a4091b02e1 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:51.758996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9d958-089f-4bdd-a9b6-42a4091b02e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:51.759269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9d958-089f-4bdd-a9b6-42a4091b02e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:51.760960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-41b9d958-089f-4bdd-a9b6-42a4091b02e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:51.808336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:51.849885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9d958-089f-4bdd-a9b6-42a4091b02e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:51.852035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9d958-089f-4bdd-a9b6-42a4091b02e1 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:51.869959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 701/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:52.684290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6c05a-db77-4c7d-8193-6d5fd6155c43 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:52.684868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6c05a-db77-4c7d-8193-6d5fd6155c43 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:52.685130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6c05a-db77-4c7d-8193-6d5fd6155c43 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:52.686511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:52.691527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211fe5-744a-41e9-88f5-ddb91a389c55 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:52.691938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211fe5-744a-41e9-88f5-ddb91a389c55 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:52.692080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211fe5-744a-41e9-88f5-ddb91a389c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:52.769900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f3211fe5-744a-41e9-88f5-ddb91a389c55 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:52.771122 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f3211fe5-744a-41e9-88f5-ddb91a389c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:52.867903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:53.030399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6c05a-db77-4c7d-8193-6d5fd6155c43 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:53.031848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a7b6c05a-db77-4c7d-8193-6d5fd6155c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:53.081488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:53.178195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6c05a-db77-4c7d-8193-6d5fd6155c43 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:53.290383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc3fb8-758b-4d4c-a9f6-fc8f73242ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:53.290941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3fb8-758b-4d4c-a9f6-fc8f73242ae7 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:53.291227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3fb8-758b-4d4c-a9f6-fc8f73242ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:53.291495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc3fb8-758b-4d4c-a9f6-fc8f73242ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:53.293153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b3fc3fb8-758b-4d4c-a9f6-fc8f73242ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:53.300034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:53.385884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc3fb8-758b-4d4c-a9f6-fc8f73242ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:53.387495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc3fb8-758b-4d4c-a9f6-fc8f73242ae7 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:53.405500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 729/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:10:54.227421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5090b-ca49-4bf9-876b-a19b91147874 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:54.227980 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5090b-ca49-4bf9-876b-a19b91147874 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:54.227980 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5090b-ca49-4bf9-876b-a19b91147874 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:54.229291 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:54.234632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772ec7-62ab-4b1c-a4f1-7dabef978857 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:54.235125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772ec7-62ab-4b1c-a4f1-7dabef978857 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:54.235347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772ec7-62ab-4b1c-a4f1-7dabef978857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:54.308095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9d772ec7-62ab-4b1c-a4f1-7dabef978857 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:54.309329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9d772ec7-62ab-4b1c-a4f1-7dabef978857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:54.375929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:54.405272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:54.560322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5090b-ca49-4bf9-876b-a19b91147874 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:54.561838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7af5090b-ca49-4bf9-876b-a19b91147874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:54.579744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:54.707702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5090b-ca49-4bf9-876b-a19b91147874 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:54.794262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:54.819949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df8c98-0c5d-4736-ab3d-2639ba91478c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:54.820621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df8c98-0c5d-4736-ab3d-2639ba91478c service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:54.821160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df8c98-0c5d-4736-ab3d-2639ba91478c service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:54.821430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df8c98-0c5d-4736-ab3d-2639ba91478c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:54.823050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-69df8c98-0c5d-4736-ab3d-2639ba91478c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:54.909901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df8c98-0c5d-4736-ab3d-2639ba91478c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:54.911523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df8c98-0c5d-4736-ab3d-2639ba91478c service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:54.930957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 704/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:55.747646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c09d1-9ea7-43e3-a0d8-cc31067cbaaf None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:55.748230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c09d1-9ea7-43e3-a0d8-cc31067cbaaf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:55.748230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c09d1-9ea7-43e3-a0d8-cc31067cbaaf None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:55.749595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:55.754420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1c97-6735-49b8-a912-1849c9804a4f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:55.754815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1c97-6735-49b8-a912-1849c9804a4f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:55.754976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1c97-6735-49b8-a912-1849c9804a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:55.829562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-60bd1c97-6735-49b8-a912-1849c9804a4f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:55.830691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-60bd1c97-6735-49b8-a912-1849c9804a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:55.871605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:55.925570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:56.075714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c09d1-9ea7-43e3-a0d8-cc31067cbaaf None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:56.077316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-180c09d1-9ea7-43e3-a0d8-cc31067cbaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:56.221394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c09d1-9ea7-43e3-a0d8-cc31067cbaaf None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:56.275285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:56.333529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef710ee-47df-4165-a508-58666af42ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:56.334201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef710ee-47df-4165-a508-58666af42ca0 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:56.334482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef710ee-47df-4165-a508-58666af42ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:56.334756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef710ee-47df-4165-a508-58666af42ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:56.336423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0ef710ee-47df-4165-a508-58666af42ca0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:56.421767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef710ee-47df-4165-a508-58666af42ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:56.423365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef710ee-47df-4165-a508-58666af42ca0 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:56.441292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 732/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:57.253511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a514a25-d90e-4ed3-a929-4ec179cad8e3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:57.254079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a514a25-d90e-4ed3-a929-4ec179cad8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:57.254079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a514a25-d90e-4ed3-a929-4ec179cad8e3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:57.255439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:57.260555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6269f9-c0fa-42c6-b988-fcd113e12206 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:57.261033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6269f9-c0fa-42c6-b988-fcd113e12206 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:57.261218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6269f9-c0fa-42c6-b988-fcd113e12206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:57.336990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bd6269f9-c0fa-42c6-b988-fcd113e12206 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:57.338219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bd6269f9-c0fa-42c6-b988-fcd113e12206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:57.340251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:57.434115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:10:57.584361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a514a25-d90e-4ed3-a929-4ec179cad8e3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:10:57.585863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1a514a25-d90e-4ed3-a929-4ec179cad8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:57.730611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a514a25-d90e-4ed3-a929-4ec179cad8e3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:10:57.756597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:57.842261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b12b36-6b21-46cb-b673-c41898c8f853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:10:57.842915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12b36-6b21-46cb-b673-c41898c8f853 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:57.843196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12b36-6b21-46cb-b673-c41898c8f853 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:57.843468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b12b36-6b21-46cb-b673-c41898c8f853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:57.845135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a5b12b36-6b21-46cb-b673-c41898c8f853 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:10:57.933039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b12b36-6b21-46cb-b673-c41898c8f853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:10:57.934648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b12b36-6b21-46cb-b673-c41898c8f853 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:10:57.952720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 707/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:10:59.881868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb591-3a47-413e-bf15-abb33898840c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:59.882382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb591-3a47-413e-bf15-abb33898840c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:59.882483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb591-3a47-413e-bf15-abb33898840c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:59.883861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:10:59.889201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ff0ea-9b9b-4e6c-99dd-cce2fd1072f0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:10:59.889626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ff0ea-9b9b-4e6c-99dd-cce2fd1072f0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:10:59.889796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ff0ea-9b9b-4e6c-99dd-cce2fd1072f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:10:59.930677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:10:59.956712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-db6ff0ea-9b9b-4e6c-99dd-cce2fd1072f0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:10:59.957946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-db6ff0ea-9b9b-4e6c-99dd-cce2fd1072f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:00.055487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:00.093889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acb591-3a47-413e-bf15-abb33898840c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:00.095426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-08acb591-3a47-413e-bf15-abb33898840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:00.197544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acb591-3a47-413e-bf15-abb33898840c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:00.230348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:00.271402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3a6f3-0a54-4dcf-b1c3-aa3f353f455b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:00.272574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a6f3-0a54-4dcf-b1c3-aa3f353f455b service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:00.272856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a6f3-0a54-4dcf-b1c3-aa3f353f455b service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:00.273126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a6f3-0a54-4dcf-b1c3-aa3f353f455b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:00.274757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-07d3a6f3-0a54-4dcf-b1c3-aa3f353f455b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:00.380932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3a6f3-0a54-4dcf-b1c3-aa3f353f455b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:00.382919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3a6f3-0a54-4dcf-b1c3-aa3f353f455b service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:00.400981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 735/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:02.630480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3492f-cd77-4c75-a823-712ef28f5ed3 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:02.631595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3492f-cd77-4c75-a823-712ef28f5ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:02.631958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3492f-cd77-4c75-a823-712ef28f5ed3 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:02.634841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:02.640888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679526a-2057-4eef-afa7-f119b331a949 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:02.641382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679526a-2057-4eef-afa7-f119b331a949 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:02.641487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679526a-2057-4eef-afa7-f119b331a949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:02.712632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5679526a-2057-4eef-afa7-f119b331a949 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:02.713877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5679526a-2057-4eef-afa7-f119b331a949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:02.727445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:02.826071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:02.867882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3492f-cd77-4c75-a823-712ef28f5ed3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:02.869465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1ad3492f-cd77-4c75-a823-712ef28f5ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:02.990583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3492f-cd77-4c75-a823-712ef28f5ed3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:03.003509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:03.068230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6b6f3-3eb8-4f60-9595-38e390e4920d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:03.069565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6b6f3-3eb8-4f60-9595-38e390e4920d service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:03.069841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6b6f3-3eb8-4f60-9595-38e390e4920d service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:03.070112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6b6f3-3eb8-4f60-9595-38e390e4920d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:03.072027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-03b6b6f3-3eb8-4f60-9595-38e390e4920d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:03.184490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6b6f3-3eb8-4f60-9595-38e390e4920d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:03.185929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6b6f3-3eb8-4f60-9595-38e390e4920d service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:03.203641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 710/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:05.560915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd4c56-30c6-4def-a8dc-18a25851e2b9 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:05.561431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd4c56-30c6-4def-a8dc-18a25851e2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:05.561541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd4c56-30c6-4def-a8dc-18a25851e2b9 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:05.562842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:05.568065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489f72-2def-4db5-9937-0229961c0c42 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:05.568505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489f72-2def-4db5-9937-0229961c0c42 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:05.568677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17489f72-2def-4db5-9937-0229961c0c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:05.615110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:05.634210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-17489f72-2def-4db5-9937-0229961c0c42 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:05.635433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-17489f72-2def-4db5-9937-0229961c0c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:05.729857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:05.768363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd4c56-30c6-4def-a8dc-18a25851e2b9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:05.769886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-29bd4c56-30c6-4def-a8dc-18a25851e2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:05.870729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd4c56-30c6-4def-a8dc-18a25851e2b9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:05.910623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:05.944664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e631e5a-1920-482c-82cf-1959010f91cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:05.945309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e631e5a-1920-482c-82cf-1959010f91cf service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:05.945586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e631e5a-1920-482c-82cf-1959010f91cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:05.946109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e631e5a-1920-482c-82cf-1959010f91cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:05.947748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4e631e5a-1920-482c-82cf-1959010f91cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:06.054174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e631e5a-1920-482c-82cf-1959010f91cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:06.055620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e631e5a-1920-482c-82cf-1959010f91cf service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:06.074444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 738/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:08.247446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccdfbe-55d0-4fbb-8fd8-c89b5902ddd0 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:08.247960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccdfbe-55d0-4fbb-8fd8-c89b5902ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:08.247960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccdfbe-55d0-4fbb-8fd8-c89b5902ddd0 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:08.249346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:08.254683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b344-6ec8-4a0b-82c9-03ad979afe83 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:08.255112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b344-6ec8-4a0b-82c9-03ad979afe83 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:08.255227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417b344-6ec8-4a0b-82c9-03ad979afe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:08.320275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4417b344-6ec8-4a0b-82c9-03ad979afe83 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:08.321771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4417b344-6ec8-4a0b-82c9-03ad979afe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:08.342187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:08.418424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:08.458770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccdfbe-55d0-4fbb-8fd8-c89b5902ddd0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:08.460349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-35ccdfbe-55d0-4fbb-8fd8-c89b5902ddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:08.565233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccdfbe-55d0-4fbb-8fd8-c89b5902ddd0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:08.585550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:08.639202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9b30a-d84b-4c75-82ca-efb57158f4cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:08.639857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9b30a-d84b-4c75-82ca-efb57158f4cf service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:08.640169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9b30a-d84b-4c75-82ca-efb57158f4cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:08.640446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9b30a-d84b-4c75-82ca-efb57158f4cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:08.642098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-67b9b30a-d84b-4c75-82ca-efb57158f4cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:08.753823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9b30a-d84b-4c75-82ca-efb57158f4cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:08.755269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9b30a-d84b-4c75-82ca-efb57158f4cf service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:08.774061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 713/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:10.938645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359361-b326-4553-8a5a-2ec5c9c40cd0 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:10.939325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359361-b326-4553-8a5a-2ec5c9c40cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:10.939325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359361-b326-4553-8a5a-2ec5c9c40cd0 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:10.940489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:10.945728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0fe3-e3a1-43fd-ac64-f85ed865000c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:10.946429 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0fe3-e3a1-43fd-ac64-f85ed865000c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:10.946551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0fe3-e3a1-43fd-ac64-f85ed865000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:11.014481 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:11.017570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e47d0fe3-e3a1-43fd-ac64-f85ed865000c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:11.019714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e47d0fe3-e3a1-43fd-ac64-f85ed865000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:11.117498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:11:11.154199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48359361-b326-4553-8a5a-2ec5c9c40cd0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:11.155733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-48359361-b326-4553-8a5a-2ec5c9c40cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:11.263628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48359361-b326-4553-8a5a-2ec5c9c40cd0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:11.314614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:11.340707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767ac4-59cc-4a3b-88e2-75f24dc2a2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:11.341359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767ac4-59cc-4a3b-88e2-75f24dc2a2de service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:11.341637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767ac4-59cc-4a3b-88e2-75f24dc2a2de service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:11.341908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767ac4-59cc-4a3b-88e2-75f24dc2a2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:11.343544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-75767ac4-59cc-4a3b-88e2-75f24dc2a2de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:11.456013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75767ac4-59cc-4a3b-88e2-75f24dc2a2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:11.457494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75767ac4-59cc-4a3b-88e2-75f24dc2a2de service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:11.476570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 741/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:13.533156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb954b0-e1e1-4688-9b55-8d672456ffbe None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:13.533597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb954b0-e1e1-4688-9b55-8d672456ffbe None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:13.533755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb954b0-e1e1-4688-9b55-8d672456ffbe None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:13.535187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:13.540768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269438-3246-4bff-abb6-2865daa0e16a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:13.541243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269438-3246-4bff-abb6-2865daa0e16a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:13.541360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec269438-3246-4bff-abb6-2865daa0e16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:13.603913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ec269438-3246-4bff-abb6-2865daa0e16a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:13.605147 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ec269438-3246-4bff-abb6-2865daa0e16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:13.634540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:13.700618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:13.737435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb954b0-e1e1-4688-9b55-8d672456ffbe None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:13.738967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8eb954b0-e1e1-4688-9b55-8d672456ffbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:13.841609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb954b0-e1e1-4688-9b55-8d672456ffbe None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:13.869989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:13.915956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6869e5-9205-4877-9f3e-59c8ce2ad0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:13.916756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6869e5-9205-4877-9f3e-59c8ce2ad0da service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:13.916929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6869e5-9205-4877-9f3e-59c8ce2ad0da service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:13.917207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6869e5-9205-4877-9f3e-59c8ce2ad0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:13.918879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6c6869e5-9205-4877-9f3e-59c8ce2ad0da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:14.031918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6869e5-9205-4877-9f3e-59c8ce2ad0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:14.033800 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6869e5-9205-4877-9f3e-59c8ce2ad0da service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:14.053440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 716/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:16.150314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357ae6-b49e-4d75-b49f-42f9aa33a60f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:16.150835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357ae6-b49e-4d75-b49f-42f9aa33a60f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:16.150835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c357ae6-b49e-4d75-b49f-42f9aa33a60f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:16.152186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:16.157476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0b79-381f-4a88-8524-7a35f7152c23 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:16.157913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0b79-381f-4a88-8524-7a35f7152c23 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:16.158035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc0b79-381f-4a88-8524-7a35f7152c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:16.225498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5bcc0b79-381f-4a88-8524-7a35f7152c23 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:16.226720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5bcc0b79-381f-4a88-8524-7a35f7152c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:16.235264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:16.324939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:16.363481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c357ae6-b49e-4d75-b49f-42f9aa33a60f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:16.365072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7c357ae6-b49e-4d75-b49f-42f9aa33a60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:16.472042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c357ae6-b49e-4d75-b49f-42f9aa33a60f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:16.526371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:16.545945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3798d-29f0-4d21-82f8-c0b1a0da5ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:16.546599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3798d-29f0-4d21-82f8-c0b1a0da5ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:16.546880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3798d-29f0-4d21-82f8-c0b1a0da5ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:16.547152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3798d-29f0-4d21-82f8-c0b1a0da5ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:16.548866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-61c3798d-29f0-4d21-82f8-c0b1a0da5ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:16.655949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3798d-29f0-4d21-82f8-c0b1a0da5ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:16.657426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3798d-29f0-4d21-82f8-c0b1a0da5ca2 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:16.675293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 744/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:18.800843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e82ca-9528-4c6a-a641-2a164addc51a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:18.801393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e82ca-9528-4c6a-a641-2a164addc51a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:18.801393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e82ca-9528-4c6a-a641-2a164addc51a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:18.803200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:18.808622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ed6f-f2fa-41a6-a8c3-a61120c9f631 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:18.809087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ed6f-f2fa-41a6-a8c3-a61120c9f631 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:18.809186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ed6f-f2fa-41a6-a8c3-a61120c9f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:18.873718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2a33ed6f-f2fa-41a6-a8c3-a61120c9f631 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:18.874918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2a33ed6f-f2fa-41a6-a8c3-a61120c9f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:18.911360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:18.968946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:19.007241 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e82ca-9528-4c6a-a641-2a164addc51a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:19.008851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-681e82ca-9528-4c6a-a641-2a164addc51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:19.130498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e82ca-9528-4c6a-a641-2a164addc51a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:19.169367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:19.220476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d601d1-30cf-4033-982c-664bc5004b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:19.221139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d601d1-30cf-4033-982c-664bc5004b1f service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:19.221426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d601d1-30cf-4033-982c-664bc5004b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:19.221707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d601d1-30cf-4033-982c-664bc5004b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:19.223404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-62d601d1-30cf-4033-982c-664bc5004b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:19.341431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d601d1-30cf-4033-982c-664bc5004b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:19.344232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d601d1-30cf-4033-982c-664bc5004b1f service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:19.373401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 719/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:21.421110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c316992-70c3-4ecb-aaea-41840e053b56 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:21.421680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c316992-70c3-4ecb-aaea-41840e053b56 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:21.421680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c316992-70c3-4ecb-aaea-41840e053b56 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:21.423049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:21.428419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e9bdc-04b8-4395-aa67-6c89b4d3b0b6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:21.428846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e9bdc-04b8-4395-aa67-6c89b4d3b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:21.428971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e9bdc-04b8-4395-aa67-6c89b4d3b0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:21.492628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-254e9bdc-04b8-4395-aa67-6c89b4d3b0b6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:21.493847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-254e9bdc-04b8-4395-aa67-6c89b4d3b0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:21.511934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:21.592377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:21.627927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c316992-70c3-4ecb-aaea-41840e053b56 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:21.629486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3c316992-70c3-4ecb-aaea-41840e053b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:21.733325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c316992-70c3-4ecb-aaea-41840e053b56 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:21.798511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:21.806623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b85c23-c994-4857-b500-9ee09d5d7696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:21.807279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b85c23-c994-4857-b500-9ee09d5d7696 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:21.807563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b85c23-c994-4857-b500-9ee09d5d7696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:21.807840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b85c23-c994-4857-b500-9ee09d5d7696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:21.809635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c3b85c23-c994-4857-b500-9ee09d5d7696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:21.916632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b85c23-c994-4857-b500-9ee09d5d7696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:21.918086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b85c23-c994-4857-b500-9ee09d5d7696 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:21.938443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 747/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:24.022783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe7c6-e12b-44e9-9184-ad524e04db1d None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:24.023434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe7c6-e12b-44e9-9184-ad524e04db1d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:24.023434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe7c6-e12b-44e9-9184-ad524e04db1d None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:24.024749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:24.030303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa239f-890f-41c8-be2d-7cadac475d23 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:24.030814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa239f-890f-41c8-be2d-7cadac475d23 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:24.030918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa239f-890f-41c8-be2d-7cadac475d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:24.099643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3baa239f-890f-41c8-be2d-7cadac475d23 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:24.100894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3baa239f-890f-41c8-be2d-7cadac475d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:24.155125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:24.204169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:24.241764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fe7c6-e12b-44e9-9184-ad524e04db1d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:24.243320 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-134fe7c6-e12b-44e9-9184-ad524e04db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:24.344262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fe7c6-e12b-44e9-9184-ad524e04db1d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:24.391881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:24.420367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274fcb1-e7f9-4b9b-938e-e4bfc52ba2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:24.420940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fcb1-e7f9-4b9b-938e-e4bfc52ba2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:24.421219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fcb1-e7f9-4b9b-938e-e4bfc52ba2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:24.421536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fcb1-e7f9-4b9b-938e-e4bfc52ba2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:24.423186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f274fcb1-e7f9-4b9b-938e-e4bfc52ba2d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:24.532303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274fcb1-e7f9-4b9b-938e-e4bfc52ba2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:24.533438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274fcb1-e7f9-4b9b-938e-e4bfc52ba2d0 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:24.552007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 722/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:34.202379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=22 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:34.549713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=66 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:44.568660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6109-5e9b-4ee1-85bc-af9d342a8294 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:44.569250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6109-5e9b-4ee1-85bc-af9d342a8294 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:44.569508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6109-5e9b-4ee1-85bc-af9d342a8294 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:44.571274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 749/1471] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:11:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:44.581504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452d17d-80ae-4a54-b1b5-32d0ad8b5317 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:44.582115 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452d17d-80ae-4a54-b1b5-32d0ad8b5317 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:44.582506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452d17d-80ae-4a54-b1b5-32d0ad8b5317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:44.658947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e452d17d-80ae-4a54-b1b5-32d0ad8b5317 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:44.660225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e452d17d-80ae-4a54-b1b5-32d0ad8b5317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:44.772579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 723/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:44.867448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd270c-1b58-4ead-aa63-a315efe9e9f8 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:44.867741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd270c-1b58-4ead-aa63-a315efe9e9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:44.868020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd270c-1b58-4ead-aa63-a315efe9e9f8 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:44.869422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 750/1473] 10.222.0.17 () {54 vars in 962 bytes} [Thu Jul 14 11:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:44.874162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d458a-bec2-48ff-b24c-4a8f9f73a7ca None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:44.874447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d458a-bec2-48ff-b24c-4a8f9f73a7ca None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:44.874721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d458a-bec2-48ff-b24c-4a8f9f73a7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:44.989683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-759d458a-bec2-48ff-b24c-4a8f9f73a7ca None None] MFA Rules not processed for user `4c97bd14230147a5bd004c71f5387098`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:44.991437 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-759d458a-bec2-48ff-b24c-4a8f9f73a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:45.028280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:45.119690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 724/1474] 10.222.0.17 () {58 vars in 1059 bytes} [Thu Jul 14 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:45.136710 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd270c-1b58-4ead-aa63-a315efe9e9f8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:45.138439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-16dd270c-1b58-4ead-aa63-a315efe9e9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:45.279795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd270c-1b58-4ead-aa63-a315efe9e9f8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:45.384909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bd521-142b-474e-9b77-3a42c35e67a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c97bd14230147a5bd004c71f5387098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:45.385523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd521-142b-474e-9b77-3a42c35e67a5 service glance] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:45.385799 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd521-142b-474e-9b77-3a42c35e67a5 service glance] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:45.386071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bd521-142b-474e-9b77-3a42c35e67a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:45.387856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8f3bd521-142b-474e-9b77-3a42c35e67a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:45.489306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:45.576224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bd521-142b-474e-9b77-3a42c35e67a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:45.577722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bd521-142b-474e-9b77-3a42c35e67a5 service glance] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:45.603754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 751/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:11:47.974899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c628d-7614-4830-a3e8-ae1e55fa4ee4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:47.975680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c628d-7614-4830-a3e8-ae1e55fa4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:47.975680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c628d-7614-4830-a3e8-ae1e55fa4ee4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:47.976986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 725/1476] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:11:47.984057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7afb-73cd-4a70-b3c3-8f02270e5a09 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:47.984625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7afb-73cd-4a70-b3c3-8f02270e5a09 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:47.985057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb7afb-73cd-4a70-b3c3-8f02270e5a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:48.075781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c0fb7afb-73cd-4a70-b3c3-8f02270e5a09 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:48.077800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c0fb7afb-73cd-4a70-b3c3-8f02270e5a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:48.201881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 752/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:11:48.231706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c628d-7614-4830-a3e8-ae1e55fa4ee4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:48.233258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-104c628d-7614-4830-a3e8-ae1e55fa4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:48.394719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c628d-7614-4830-a3e8-ae1e55fa4ee4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:48.460201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:48.513321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4cd8d-2691-4c74-915e-69f29d5dd8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:48.513995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4cd8d-2691-4c74-915e-69f29d5dd8fa admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:48.514275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4cd8d-2691-4c74-915e-69f29d5dd8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:48.514551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4cd8d-2691-4c74-915e-69f29d5dd8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:48.515352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4cd8d-2691-4c74-915e-69f29d5dd8fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:48.517376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-f5e4cd8d-2691-4c74-915e-69f29d5dd8fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:11:48.517376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Jul 14 11:11:48.517376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: Jul 14 11:11:48.518662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4cd8d-2691-4c74-915e-69f29d5dd8fa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:48.562796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 726/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Thu Jul 14 11:11:48 2022] GET /identity/v3/projects => generated 2553 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:11:50.906025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5d1f-2f5b-4753-b0d3-cbb092d1d96e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:50.906958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5d1f-2f5b-4753-b0d3-cbb092d1d96e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:50.906958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5d1f-2f5b-4753-b0d3-cbb092d1d96e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:50.908822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 753/1479] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 11:11:50.916362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691962e-f527-4c11-bb51-3bbf7a093a98 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:50.916899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691962e-f527-4c11-bb51-3bbf7a093a98 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:50.916899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691962e-f527-4c11-bb51-3bbf7a093a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:51.008043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8691962e-f527-4c11-bb51-3bbf7a093a98 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:51.009310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8691962e-f527-4c11-bb51-3bbf7a093a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:51.133803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 727/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:51.181014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5d1f-2f5b-4753-b0d3-cbb092d1d96e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:51.182725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a7ea5d1f-2f5b-4753-b0d3-cbb092d1d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:51.199108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:51.365216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5d1f-2f5b-4753-b0d3-cbb092d1d96e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:51.484045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:51.520519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad305d-d5f5-4034-be5e-7c5122a6e588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:51.521776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad305d-d5f5-4034-be5e-7c5122a6e588 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:51.522059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad305d-d5f5-4034-be5e-7c5122a6e588 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:51.522335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad305d-d5f5-4034-be5e-7c5122a6e588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:51.524003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-75ad305d-d5f5-4034-be5e-7c5122a6e588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:51.635232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad305d-d5f5-4034-be5e-7c5122a6e588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:51.636891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad305d-d5f5-4034-be5e-7c5122a6e588 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:51.656201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 754/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:54.233372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223aab-a91f-4385-8454-5a706d11245a None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:54.233937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223aab-a91f-4385-8454-5a706d11245a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:54.233937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223aab-a91f-4385-8454-5a706d11245a None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:54.235244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 728/1482] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:54.241702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8d53-0538-4ffd-9be6-86dbcec20398 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:54.242341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8d53-0538-4ffd-9be6-86dbcec20398 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:54.242341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e8d53-0538-4ffd-9be6-86dbcec20398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:54.315356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6d7e8d53-0538-4ffd-9be6-86dbcec20398 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:54.316617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6d7e8d53-0538-4ffd-9be6-86dbcec20398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:54.370327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:54.422621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 755/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:54.458721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223aab-a91f-4385-8454-5a706d11245a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:54.460395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d2223aab-a91f-4385-8454-5a706d11245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:54.485361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:54.690265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223aab-a91f-4385-8454-5a706d11245a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:54.762106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9223b-0d10-4e6f-9f59-f7ea2f00eea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:54.762661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9223b-0d10-4e6f-9f59-f7ea2f00eea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:54.762937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9223b-0d10-4e6f-9f59-f7ea2f00eea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:54.763206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9223b-0d10-4e6f-9f59-f7ea2f00eea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:54.764886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-76f9223b-0d10-4e6f-9f59-f7ea2f00eea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:54.837502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:54.871893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9223b-0d10-4e6f-9f59-f7ea2f00eea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:54.873359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9223b-0d10-4e6f-9f59-f7ea2f00eea9 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:54.891405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 729/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:57.008936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecde67-3abe-4069-9825-e7cd0cfa1e48 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:57.009532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecde67-3abe-4069-9825-e7cd0cfa1e48 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:57.009532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecde67-3abe-4069-9825-e7cd0cfa1e48 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:57.010847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 756/1485] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:57.015916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624238-1937-4ebb-84a1-78c2b7637461 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:57.016342 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624238-1937-4ebb-84a1-78c2b7637461 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:57.016514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf624238-1937-4ebb-84a1-78c2b7637461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:57.082375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cf624238-1937-4ebb-84a1-78c2b7637461 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:57.083579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cf624238-1937-4ebb-84a1-78c2b7637461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:57.175524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 730/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:57.213979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecde67-3abe-4069-9825-e7cd0cfa1e48 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:57.215537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-deecde67-3abe-4069-9825-e7cd0cfa1e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:57.318884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecde67-3abe-4069-9825-e7cd0cfa1e48 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:11:57.393313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:57.395436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580b334-1286-4f62-bc55-041552c9b929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:11:57.396281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b334-1286-4f62-bc55-041552c9b929 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:57.396783 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b334-1286-4f62-bc55-041552c9b929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:57.397253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b334-1286-4f62-bc55-041552c9b929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:57.399131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c580b334-1286-4f62-bc55-041552c9b929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:57.523291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580b334-1286-4f62-bc55-041552c9b929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:11:57.524774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c580b334-1286-4f62-bc55-041552c9b929 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:11:57.546125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 757/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:11:59.744787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108be2b-3719-4024-a75d-f433ee0fc792 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:59.745324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108be2b-3719-4024-a75d-f433ee0fc792 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:59.745324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108be2b-3719-4024-a75d-f433ee0fc792 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:59.746724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 731/1488] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:11:59.752310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62066-d523-4af7-8915-340d841a90c3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:11:59.752791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62066-d523-4af7-8915-340d841a90c3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:11:59.752898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f62066-d523-4af7-8915-340d841a90c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:11:59.825683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-72f62066-d523-4af7-8915-340d841a90c3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:11:59.826829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-72f62066-d523-4af7-8915-340d841a90c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:11:59.883839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:11:59.937913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 758/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:11:59.978753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108be2b-3719-4024-a75d-f433ee0fc792 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:11:59.980356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6108be2b-3719-4024-a75d-f433ee0fc792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:12:00.019710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:00.093820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108be2b-3719-4024-a75d-f433ee0fc792 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:12:00.168903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157db861-6e15-40a4-895c-4cd3f07bdcbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:12:00.169544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157db861-6e15-40a4-895c-4cd3f07bdcbf service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:12:00.169823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157db861-6e15-40a4-895c-4cd3f07bdcbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:12:00.170096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157db861-6e15-40a4-895c-4cd3f07bdcbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:12:00.171739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-157db861-6e15-40a4-895c-4cd3f07bdcbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:12:00.254767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:00.287043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157db861-6e15-40a4-895c-4cd3f07bdcbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:12:00.288742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157db861-6e15-40a4-895c-4cd3f07bdcbf service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:12:00.307762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 732/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:12:02.552729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328b09-f646-4a5f-8bfb-f2b48f95f4f0 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:12:02.553304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328b09-f646-4a5f-8bfb-f2b48f95f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:12:02.553304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69328b09-f646-4a5f-8bfb-f2b48f95f4f0 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:12:02.554970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 759/1491] 10.222.0.17 () {54 vars in 926 bytes} [Thu Jul 14 11:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:12:02.560877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb70740-711f-4b3b-bf07-f296f8974ab2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:12:02.561379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb70740-711f-4b3b-bf07-f296f8974ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:12:02.561487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb70740-711f-4b3b-bf07-f296f8974ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:12:02.634432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7fb70740-711f-4b3b-bf07-f296f8974ab2 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:12:02.635680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7fb70740-711f-4b3b-bf07-f296f8974ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:12:02.755031 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 733/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Thu Jul 14 11:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:12:02.795143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328b09-f646-4a5f-8bfb-f2b48f95f4f0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:12:02.796771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-69328b09-f646-4a5f-8bfb-f2b48f95f4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:12:02.912553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69328b09-f646-4a5f-8bfb-f2b48f95f4f0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:12:02.988460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1479b6-9e2d-4c8a-b209-c86102896034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:12:02.989116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1479b6-9e2d-4c8a-b209-c86102896034 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:12:02.989959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1479b6-9e2d-4c8a-b209-c86102896034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:12:02.990264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1479b6-9e2d-4c8a-b209-c86102896034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:12:02.991930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-df1479b6-9e2d-4c8a-b209-c86102896034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:12:03.001959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:03.113293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1479b6-9e2d-4c8a-b209-c86102896034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:12:03.114746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1479b6-9e2d-4c8a-b209-c86102896034 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:12:03.134441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 760/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:12:12.749592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=82 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:12:13.131429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=50 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:30.843396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f71bf-46ea-4bc6-86a5-8a569c7aebe4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:30.844014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f71bf-46ea-4bc6-86a5-8a569c7aebe4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:30.844014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f71bf-46ea-4bc6-86a5-8a569c7aebe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:30.924074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d69f71bf-46ea-4bc6-86a5-8a569c7aebe4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:13:30.925349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d69f71bf-46ea-4bc6-86a5-8a569c7aebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:31.025351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 734/1494] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:13:31.033521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98b332-07af-4626-ab56-7719d5053219 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:31.034067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98b332-07af-4626-ab56-7719d5053219 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:31.034067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98b332-07af-4626-ab56-7719d5053219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:31.119975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cf98b332-07af-4626-ab56-7719d5053219 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:13:31.121173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cf98b332-07af-4626-ab56-7719d5053219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:31.234427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 761/1495] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:13:31.239899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f71bf-46ea-4bc6-86a5-8a569c7aebe4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:31.241322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d69f71bf-46ea-4bc6-86a5-8a569c7aebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:31.253434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f71bf-46ea-4bc6-86a5-8a569c7aebe4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:31.323718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:31.361137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:31.361818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:31.362096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:31.362371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:31.363730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:13:31.364041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:31.365109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:13:31.365109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Jul 14 11:13:31.365109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: Jul 14 11:13:31.366012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:31.379377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 735/1496] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:13:31.387078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98b332-07af-4626-ab56-7719d5053219 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:31.397009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98b332-07af-4626-ab56-7719d5053219 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:31.461789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:31.497565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:31.498231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:31.498519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:31.498799 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:31.499504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:31.501322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING py.warnings [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:13:31.501322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: warnings.warn(msg) Jul 14 11:13:31.501322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: Jul 14 11:13:31.502541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:31.564339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 762/1497] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:13:31 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:13:31.568689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:31.570223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:31.606535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da859c-5509-4805-9e6d-3e1623b63b26 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:31.700559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:31.701149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:31.701433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:31.701704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:31.702389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:31.703407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:13:31.703407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Jul 14 11:13:31.703407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: Jul 14 11:13:31.704650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:31.747122 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 736/1498] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:13:31 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:13:31.751324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:31.752959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:31.816873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7b7f-aa5a-4007-8f81-fab671fb3a79 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:31.914447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:31.927272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:31.927950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:31.928266 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:31.928539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:31.929302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:31.930340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING py.warnings [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:13:31.930340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: warnings.warn(msg) Jul 14 11:13:31.930340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: Jul 14 11:13:31.931227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:31.946809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 763/1499] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:13:31.951123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:31.952800 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:31.964668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9cc23-c745-4254-989e-a32da4657f0f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:31.997295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:32.066951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400587be-5102-4416-be8d-19c9e9f337bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:32.067618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400587be-5102-4416-be8d-19c9e9f337bf admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:32.067900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400587be-5102-4416-be8d-19c9e9f337bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:32.068205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400587be-5102-4416-be8d-19c9e9f337bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:32.068929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400587be-5102-4416-be8d-19c9e9f337bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:32.069954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-400587be-5102-4416-be8d-19c9e9f337bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:13:32.069954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Jul 14 11:13:32.069954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: Jul 14 11:13:32.070832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400587be-5102-4416-be8d-19c9e9f337bf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:32.083881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 737/1500] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:13:32.087988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:32.089641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:32.121772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebabca-7f6b-4f48-ae8e-4523878c9264 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:32.218190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dcab6-f688-44cf-a37f-9ebd9cbe3866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:32.219002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dcab6-f688-44cf-a37f-9ebd9cbe3866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:32.219283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dcab6-f688-44cf-a37f-9ebd9cbe3866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:32.219557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dcab6-f688-44cf-a37f-9ebd9cbe3866 admin admin] PATH_INFO: `/v3/projects/4536ef744d904fe8bdb5af0daedd87fa/users/ade583a7b1194a9c87b669056ee03d01/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:32.243454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dcab6-f688-44cf-a37f-9ebd9cbe3866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4536ef744d904fe8bdb5af0daedd87fa, user_id=ade583a7b1194a9c87b669056ee03d01, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:32.244546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING py.warnings [None req-907dcab6-f688-44cf-a37f-9ebd9cbe3866 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:13:32.244546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: warnings.warn(msg) Jul 14 11:13:32.244546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: Jul 14 11:13:32.246683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dcab6-f688-44cf-a37f-9ebd9cbe3866 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:32.275159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 764/1501] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:13:32 2022] PUT /identity/v3/projects/4536ef744d904fe8bdb5af0daedd87fa/users/ade583a7b1194a9c87b669056ee03d01/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:13:32.289147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250dc4-e03a-45c8-8752-7b486461e074 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:32.289444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250dc4-e03a-45c8-8752-7b486461e074 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:32.289847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06250dc4-e03a-45c8-8752-7b486461e074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:32.353866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-06250dc4-e03a-45c8-8752-7b486461e074 None None] MFA Rules not processed for user `ade583a7b1194a9c87b669056ee03d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:13:32.355165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06250dc4-e03a-45c8-8752-7b486461e074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:32.442575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 738/1502] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:13:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:13:32.456012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a068-c1d1-45eb-aaea-f86f90394219 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:32.456332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a068-c1d1-45eb-aaea-f86f90394219 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:32.456610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680a068-c1d1-45eb-aaea-f86f90394219 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:32.458032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 765/1503] 10.222.0.17 () {54 vars in 963 bytes} [Thu Jul 14 11:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:13:32.463164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76ccca-7fe7-43b0-97ac-f7bed44bdbdf None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:32.463449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76ccca-7fe7-43b0-97ac-f7bed44bdbdf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:32.463720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76ccca-7fe7-43b0-97ac-f7bed44bdbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:32.496094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:32.546707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5c76ccca-7fe7-43b0-97ac-f7bed44bdbdf None None] MFA Rules not processed for user `c46f7ca6d48c4124a9af1dc3a74c37a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:13:32.547931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5c76ccca-7fe7-43b0-97ac-f7bed44bdbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:32.624160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 739/1504] 10.222.0.17 () {58 vars in 1060 bytes} [Thu Jul 14 11:13:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:13:32.632378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a068-c1d1-45eb-aaea-f86f90394219 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:32.633894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3680a068-c1d1-45eb-aaea-f86f90394219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:32.682457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:32.736760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3680a068-c1d1-45eb-aaea-f86f90394219 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:32.806755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:32.807322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:32.807600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:32.807871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:32.809525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:32.905697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:32.907133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:32.910622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:32.925365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 766/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:13:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:13:32.967782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8cf7-aef0-46f0-ab21-4b5e4eb7c632 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:32.968245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8cf7-aef0-46f0-ab21-4b5e4eb7c632 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:32.968374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8cf7-aef0-46f0-ab21-4b5e4eb7c632 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:32.969651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 740/1506] 10.222.0.17 () {52 vars in 829 bytes} [Thu Jul 14 11:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:13:32.973154 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:32.974363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:33.072198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d6dd7-e72c-4683-b836-b80cff15ae08 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:33.162686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:33.163562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:33.163844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:33.164134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] PATH_INFO: `/v3/users/ade583a7b1194a9c87b669056ee03d01` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:33.177235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade583a7b1194a9c87b669056ee03d01)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:33.178273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING py.warnings [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:13:33.178273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: warnings.warn(msg) Jul 14 11:13:33.178273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: Jul 14 11:13:33.179485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:33.188932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:33.243691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade583a7b1194a9c87b669056ee03d01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:33.244151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade583a7b1194a9c87b669056ee03d01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:33.257908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade583a7b1194a9c87b669056ee03d01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:33.266940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade583a7b1194a9c87b669056ee03d01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:33.267640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade583a7b1194a9c87b669056ee03d01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:33.290053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 767/1507] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:13:32 2022] DELETE /identity/v3/users/ade583a7b1194a9c87b669056ee03d01 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:13:33.294500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca268a4-a2c2-44f6-8e66-9a167e601045 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:33.294912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca268a4-a2c2-44f6-8e66-9a167e601045 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:33.295176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca268a4-a2c2-44f6-8e66-9a167e601045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:33.348901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cca268a4-a2c2-44f6-8e66-9a167e601045 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:13:33.350099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cca268a4-a2c2-44f6-8e66-9a167e601045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:33.426883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:33.439765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 741/1508] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:13:33.449618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:33.450967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:33.567519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056db6d4-9c83-440b-af56-e3fd47c8aa84 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:33.623107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:33.644552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e876f80-5dce-4837-ad2e-26f1fb88a992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:33.645216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e876f80-5dce-4837-ad2e-26f1fb88a992 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:33.645499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e876f80-5dce-4837-ad2e-26f1fb88a992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:33.645776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e876f80-5dce-4837-ad2e-26f1fb88a992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:33.647469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5e876f80-5dce-4837-ad2e-26f1fb88a992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:33.766882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e876f80-5dce-4837-ad2e-26f1fb88a992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:33.768353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e876f80-5dce-4837-ad2e-26f1fb88a992 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:33.787785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 768/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:13:34.118245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca268a4-a2c2-44f6-8e66-9a167e601045 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:13:34.119522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cca268a4-a2c2-44f6-8e66-9a167e601045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:13:34.131817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca268a4-a2c2-44f6-8e66-9a167e601045 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:13:34.231068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:13:34.231934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:13:34.232242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:13:34.232514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] PATH_INFO: `/v3/projects/4536ef744d904fe8bdb5af0daedd87fa` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:13:34.242423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4536ef744d904fe8bdb5af0daedd87fa)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:13:34.243446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:13:34.243446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Jul 14 11:13:34.243446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: Jul 14 11:13:34.244667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:13:34.302942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4536ef744d904fe8bdb5af0daedd87fa', 'request_id': 'req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:34.308853 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4536ef744d904fe8bdb5af0daedd87fa', 'request_id': 'req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:34.318848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4536ef744d904fe8bdb5af0daedd87fa', 'request_id': 'req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:34.350037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] The token cache is being invalidate because project 4536ef744d904fe8bdb5af0daedd87fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:13:34.350323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:34.350865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0ab2f0d4-3cb4-4a08-866d-b81c438fd1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:13:34.352271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 742/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:13:34 2022] DELETE /identity/v3/projects/4536ef744d904fe8bdb5af0daedd87fa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:13:43.784940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=62 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:13:44.348264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:27.285327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197c3b-a4a7-4c7f-a865-5b5fd0164254 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:27.285942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197c3b-a4a7-4c7f-a865-5b5fd0164254 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:27.285942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197c3b-a4a7-4c7f-a865-5b5fd0164254 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:27.287263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:27.292249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63edf-15a9-45df-807e-35a518c34a81 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:27.292723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63edf-15a9-45df-807e-35a518c34a81 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:27.292828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d63edf-15a9-45df-807e-35a518c34a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:27.379893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-50d63edf-15a9-45df-807e-35a518c34a81 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:27.381198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-50d63edf-15a9-45df-807e-35a518c34a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:27.496765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:15:27.653698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197c3b-a4a7-4c7f-a865-5b5fd0164254 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:27.655871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-16197c3b-a4a7-4c7f-a865-5b5fd0164254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:27.778332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197c3b-a4a7-4c7f-a865-5b5fd0164254 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:27.783728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec4cea-2bc1-4f33-91e1-950418031b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:27.784402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec4cea-2bc1-4f33-91e1-950418031b4c service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:27.784686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec4cea-2bc1-4f33-91e1-950418031b4c service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:27.784963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec4cea-2bc1-4f33-91e1-950418031b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:27.793701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec4cea-2bc1-4f33-91e1-950418031b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:27.795276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec4cea-2bc1-4f33-91e1-950418031b4c service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:27.804501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 770/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:15:28.663758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310171cc-5b47-439c-828a-788aa24d1689 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:28.664324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310171cc-5b47-439c-828a-788aa24d1689 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:28.664446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310171cc-5b47-439c-828a-788aa24d1689 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:28.665969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:28.671650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e104da-df88-4ef3-a7cb-6e1d24150eb0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:28.672142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e104da-df88-4ef3-a7cb-6e1d24150eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:28.672254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e104da-df88-4ef3-a7cb-6e1d24150eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:28.692599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-31e104da-df88-4ef3-a7cb-6e1d24150eb0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:28.693847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-31e104da-df88-4ef3-a7cb-6e1d24150eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:28.702710 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:15:28.858707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310171cc-5b47-439c-828a-788aa24d1689 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:28.872782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310171cc-5b47-439c-828a-788aa24d1689 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:28.878045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b673dad-e391-43ef-ab8e-0435a092d4cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:28.878662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b673dad-e391-43ef-ab8e-0435a092d4cd service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:28.878941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b673dad-e391-43ef-ab8e-0435a092d4cd service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:28.879212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b673dad-e391-43ef-ab8e-0435a092d4cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:28.887281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b673dad-e391-43ef-ab8e-0435a092d4cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:28.888898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b673dad-e391-43ef-ab8e-0435a092d4cd service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:28.898084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 745/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:15:30.298649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1de99-3cbc-47ac-ac2f-35d2b31d6d7c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:30.299171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1de99-3cbc-47ac-ac2f-35d2b31d6d7c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:30.299171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1de99-3cbc-47ac-ac2f-35d2b31d6d7c None None] PATH_INFO: `/v3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:30.300463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 772/1517] 10.222.0.50 () {54 vars in 925 bytes} [Thu Jul 14 11:15:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:15:30.307656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702534c-a202-4a04-b55d-90a9fab22edf None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:30.308070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702534c-a202-4a04-b55d-90a9fab22edf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:30.308239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702534c-a202-4a04-b55d-90a9fab22edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:30.365341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a702534c-a202-4a04-b55d-90a9fab22edf None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:30.366553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a702534c-a202-4a04-b55d-90a9fab22edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:30.382742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:30.438738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 746/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Jul 14 11:15:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:15:34.416592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e42a-7e2b-4c76-b161-398eeb2db7af None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:34.417634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e42a-7e2b-4c76-b161-398eeb2db7af None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:34.417789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e42a-7e2b-4c76-b161-398eeb2db7af None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:34.419062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 773/1519] 10.222.0.17 () {54 vars in 960 bytes} [Thu Jul 14 11:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:34.424458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae2300-f270-40ce-996a-184f598fad21 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:34.424959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae2300-f270-40ce-996a-184f598fad21 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:34.425068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae2300-f270-40ce-996a-184f598fad21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:34.444530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6eae2300-f270-40ce-996a-184f598fad21 None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:34.445759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6eae2300-f270-40ce-996a-184f598fad21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:34.454874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 747/1520] 10.222.0.17 () {58 vars in 1057 bytes} [Thu Jul 14 11:15:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:15:34.462725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e42a-7e2b-4c76-b161-398eeb2db7af None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:34.476692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e42a-7e2b-4c76-b161-398eeb2db7af None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:34.482380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fa641-6436-43ce-a482-3678980c9ef5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:34.483047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fa641-6436-43ce-a482-3678980c9ef5 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:34.483331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fa641-6436-43ce-a482-3678980c9ef5 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:34.483612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fa641-6436-43ce-a482-3678980c9ef5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:34.492866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fa641-6436-43ce-a482-3678980c9ef5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:34.494483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428fa641-6436-43ce-a482-3678980c9ef5 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:34.506486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 774/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:15:40.132238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf7d7-7524-45b0-a239-d5de6e2b959b None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:40.132798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf7d7-7524-45b0-a239-d5de6e2b959b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:40.132798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaf7d7-7524-45b0-a239-d5de6e2b959b None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:40.134251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:40.139694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd5ea6-9e39-44ba-a866-c72597835d62 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:40.140178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd5ea6-9e39-44ba-a866-c72597835d62 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:40.140290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd5ea6-9e39-44ba-a866-c72597835d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:40.158778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-94cd5ea6-9e39-44ba-a866-c72597835d62 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:40.159983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-94cd5ea6-9e39-44ba-a866-c72597835d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:40.167859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:15:40.328892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaf7d7-7524-45b0-a239-d5de6e2b959b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:40.344998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaf7d7-7524-45b0-a239-d5de6e2b959b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:40.350464 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c9d0b-2b30-4490-8451-dac8018acf76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:40.351095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d0b-2b30-4490-8451-dac8018acf76 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:40.351378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d0b-2b30-4490-8451-dac8018acf76 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:40.351653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c9d0b-2b30-4490-8451-dac8018acf76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:40.360336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9d0b-2b30-4490-8451-dac8018acf76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:40.361926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c9d0b-2b30-4490-8451-dac8018acf76 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:40.371824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 749/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:15:41.193390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5830f-27a0-4f2a-8144-758d5a676cc0 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:41.193974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5830f-27a0-4f2a-8144-758d5a676cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:41.194081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5830f-27a0-4f2a-8144-758d5a676cc0 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:41.195493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 11:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:41.201045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2d0c-ff86-4691-8dee-75bf485f8a9b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:41.201457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2d0c-ff86-4691-8dee-75bf485f8a9b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:41.201598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a2d0c-ff86-4691-8dee-75bf485f8a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:41.220258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-063a2d0c-ff86-4691-8dee-75bf485f8a9b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:41.221494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-063a2d0c-ff86-4691-8dee-75bf485f8a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:41.229495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 11:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:15:41.388144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5830f-27a0-4f2a-8144-758d5a676cc0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:41.402915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5830f-27a0-4f2a-8144-758d5a676cc0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:41.408423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff5892-4659-471b-b5be-ce7f2a166e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:41.409058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5892-4659-471b-b5be-ce7f2a166e05 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:41.409338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5892-4659-471b-b5be-ce7f2a166e05 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:41.409611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff5892-4659-471b-b5be-ce7f2a166e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:41.417794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff5892-4659-471b-b5be-ce7f2a166e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:41.419358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff5892-4659-471b-b5be-ce7f2a166e05 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:41.428729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 777/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:15:46.051798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823312c-9f5b-4ac3-8585-0863437288d4 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:46.052386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823312c-9f5b-4ac3-8585-0863437288d4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:46.052386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823312c-9f5b-4ac3-8585-0863437288d4 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:46.053885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:46.059086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bafb9-00b3-4fb9-82c3-1103e429a9da None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:46.059517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bafb9-00b3-4fb9-82c3-1103e429a9da None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:46.059651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bafb9-00b3-4fb9-82c3-1103e429a9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:46.077421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5e2bafb9-00b3-4fb9-82c3-1103e429a9da None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:46.078627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5e2bafb9-00b3-4fb9-82c3-1103e429a9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:46.086707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:15:46.159951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823312c-9f5b-4ac3-8585-0863437288d4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:46.161668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9823312c-9f5b-4ac3-8585-0863437288d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:46.240129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823312c-9f5b-4ac3-8585-0863437288d4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:46.243667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c37c5-f11c-465e-a1fc-01a6244bce8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:46.244344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c37c5-f11c-465e-a1fc-01a6244bce8b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:46.244627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c37c5-f11c-465e-a1fc-01a6244bce8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:46.244918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c37c5-f11c-465e-a1fc-01a6244bce8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:46.253844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c37c5-f11c-465e-a1fc-01a6244bce8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:46.255250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c37c5-f11c-465e-a1fc-01a6244bce8b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:46.264515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 752/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:15:48.332966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d1bc-39a6-41ac-b22d-b4d280446b2c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:48.333514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d1bc-39a6-41ac-b22d-b4d280446b2c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:48.333620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d1bc-39a6-41ac-b22d-b4d280446b2c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:48.334946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:48.340562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318963d-2459-4439-9c56-b25f3afd78cf None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:48.341022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318963d-2459-4439-9c56-b25f3afd78cf None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:48.341113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318963d-2459-4439-9c56-b25f3afd78cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:48.359059 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8318963d-2459-4439-9c56-b25f3afd78cf None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:48.360308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8318963d-2459-4439-9c56-b25f3afd78cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:48.368201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:15:48.405596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d1bc-39a6-41ac-b22d-b4d280446b2c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:48.407334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4600d1bc-39a6-41ac-b22d-b4d280446b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:48.420248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d1bc-39a6-41ac-b22d-b4d280446b2c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:48.424199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26c08a-d292-46de-8b2d-598c39ec0137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:48.424846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26c08a-d292-46de-8b2d-598c39ec0137 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:48.425155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26c08a-d292-46de-8b2d-598c39ec0137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:48.425431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26c08a-d292-46de-8b2d-598c39ec0137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:48.437661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26c08a-d292-46de-8b2d-598c39ec0137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:48.438831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26c08a-d292-46de-8b2d-598c39ec0137 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:48.451376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 780/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:15:52.550276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855c4e-d400-4301-81ef-133d0d0bb1ee None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:52.550844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855c4e-d400-4301-81ef-133d0d0bb1ee None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:52.550941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855c4e-d400-4301-81ef-133d0d0bb1ee None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:52.552866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:52.558908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ae57-d756-496f-a4d6-b7e4e88e251c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:52.559491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ae57-d756-496f-a4d6-b7e4e88e251c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:52.559491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ae57-d756-496f-a4d6-b7e4e88e251c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:52.579141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9bc6ae57-d756-496f-a4d6-b7e4e88e251c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:52.580389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9bc6ae57-d756-496f-a4d6-b7e4e88e251c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:52.588613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:15:52.902033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855c4e-d400-4301-81ef-133d0d0bb1ee None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:52.903740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d7855c4e-d400-4301-81ef-133d0d0bb1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:52.974247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:52.990404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855c4e-d400-4301-81ef-133d0d0bb1ee None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:52.994201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1280e62-53f6-4918-ac45-2768cb71b928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:52.995380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1280e62-53f6-4918-ac45-2768cb71b928 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:52.995658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1280e62-53f6-4918-ac45-2768cb71b928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:52.995928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1280e62-53f6-4918-ac45-2768cb71b928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:53.005559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1280e62-53f6-4918-ac45-2768cb71b928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:53.007015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1280e62-53f6-4918-ac45-2768cb71b928 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:53.017668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 755/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:15:55.131015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dbec8-4406-4d43-bc81-f28ae4e76f48 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:55.131559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dbec8-4406-4d43-bc81-f28ae4e76f48 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:55.131559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dbec8-4406-4d43-bc81-f28ae4e76f48 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:55.133008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 11:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:15:55.138663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12b31-e500-4e20-a15c-73d85e7be66f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:55.139201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12b31-e500-4e20-a15c-73d85e7be66f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:55.139201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee12b31-e500-4e20-a15c-73d85e7be66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:55.158989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1ee12b31-e500-4e20-a15c-73d85e7be66f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:15:55.160353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1ee12b31-e500-4e20-a15c-73d85e7be66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:55.169667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 11:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:15:55.493168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dbec8-4406-4d43-bc81-f28ae4e76f48 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:15:55.496048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-603dbec8-4406-4d43-bc81-f28ae4e76f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:15:55.506649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=84 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:15:55.514583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dbec8-4406-4d43-bc81-f28ae4e76f48 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:15:55.518352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783339-240e-4992-993c-ec688be0b2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:15:55.519022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783339-240e-4992-993c-ec688be0b2fd service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:15:55.519308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783339-240e-4992-993c-ec688be0b2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:15:55.519589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783339-240e-4992-993c-ec688be0b2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:15:55.531672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40783339-240e-4992-993c-ec688be0b2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:15:55.533387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40783339-240e-4992-993c-ec688be0b2fd service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:15:55.544572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 783/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:16:05.153316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=11 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:16:05.539276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:37.362143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800ab2-d74f-4fed-9f63-9c8a32bc10d5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.362830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800ab2-d74f-4fed-9f63-9c8a32bc10d5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.362830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce800ab2-d74f-4fed-9f63-9c8a32bc10d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.389299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ce800ab2-d74f-4fed-9f63-9c8a32bc10d5 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:37.391217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ce800ab2-d74f-4fed-9f63-9c8a32bc10d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:37.402617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 757/1540] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:37.412161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45700-6ef8-42e0-876b-1879d15326cb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.412794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45700-6ef8-42e0-876b-1879d15326cb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.412794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d45700-6ef8-42e0-876b-1879d15326cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.445494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-06d45700-6ef8-42e0-876b-1879d15326cb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:37.446876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-06d45700-6ef8-42e0-876b-1879d15326cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:37.462541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 784/1541] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:37.469074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce800ab2-d74f-4fed-9f63-9c8a32bc10d5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:37.485200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce800ab2-d74f-4fed-9f63-9c8a32bc10d5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:37.501133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:37.502655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.503246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.503764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.513583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dbf0f-2441-4b34-a225-2f5ccec823e4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.514119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dbf0f-2441-4b34-a225-2f5ccec823e4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.514409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dbf0f-2441-4b34-a225-2f5ccec823e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.542420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:37.543145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:37.545412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:37.565299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-701dbf0f-2441-4b34-a225-2f5ccec823e4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:37.565793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 758/1542] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:37.566893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-701dbf0f-2441-4b34-a225-2f5ccec823e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:37.575334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:37.586146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 785/1543] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:37.591569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564857af-555c-41bf-946d-5e430d68da6c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:37.595742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708ce81-f2a5-4f35-afaf-a72bf5886176 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.596057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708ce81-f2a5-4f35-afaf-a72bf5886176 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.596345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708ce81-f2a5-4f35-afaf-a72bf5886176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.605100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288179e-02d9-4c69-a074-2e92bdce544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:37.606235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288179e-02d9-4c69-a074-2e92bdce544b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.606746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288179e-02d9-4c69-a074-2e92bdce544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.607252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288179e-02d9-4c69-a074-2e92bdce544b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.608315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288179e-02d9-4c69-a074-2e92bdce544b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:37.609973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-2288179e-02d9-4c69-a074-2e92bdce544b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:17:37.609973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Jul 14 11:17:37.609973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: Jul 14 11:17:37.611863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288179e-02d9-4c69-a074-2e92bdce544b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:37.629548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4708ce81-f2a5-4f35-afaf-a72bf5886176 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:37.630708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4708ce81-f2a5-4f35-afaf-a72bf5886176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:37.652285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 786/1544] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:17:37.657336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708ce81-f2a5-4f35-afaf-a72bf5886176 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:37.672755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708ce81-f2a5-4f35-afaf-a72bf5886176 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:37.681947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 759/1545] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:17:37.683773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb394b-50dc-4bfe-857b-a983d2fdcf7e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.684350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb394b-50dc-4bfe-857b-a983d2fdcf7e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.685063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb394b-50dc-4bfe-857b-a983d2fdcf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.685279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:37.686006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.686296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.686574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.687315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:37.687621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:37.692131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING py.warnings [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:17:37.692131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: warnings.warn(msg) Jul 14 11:17:37.692131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: Jul 14 11:17:37.692131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:37.708994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 787/1546] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:37.710182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:37.724408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-dddb394b-50dc-4bfe-857b-a983d2fdcf7e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:37.726461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-dddb394b-50dc-4bfe-857b-a983d2fdcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:37.730086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9ffd7-0fd7-498d-a876-42af1a82afb3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:37.828865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead83a52-b72f-4bc5-8102-99b3a659eb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:37.829562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead83a52-b72f-4bc5-8102-99b3a659eb91 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.829849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead83a52-b72f-4bc5-8102-99b3a659eb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.830130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead83a52-b72f-4bc5-8102-99b3a659eb91 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.830836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead83a52-b72f-4bc5-8102-99b3a659eb91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:37.832209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING py.warnings [None req-ead83a52-b72f-4bc5-8102-99b3a659eb91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:17:37.832209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: warnings.warn(msg) Jul 14 11:17:37.832209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: Jul 14 11:17:37.833110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead83a52-b72f-4bc5-8102-99b3a659eb91 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:37.868772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 760/1547] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:37.872328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb394b-50dc-4bfe-857b-a983d2fdcf7e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:37.873221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 788/1548] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:37.874619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533eb5f-c9a8-4fb2-9f3e-52b2def0ace4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.874938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533eb5f-c9a8-4fb2-9f3e-52b2def0ace4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.875279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533eb5f-c9a8-4fb2-9f3e-52b2def0ace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.893431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb394b-50dc-4bfe-857b-a983d2fdcf7e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:37.911793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae929ea-ae37-47bd-933d-cc214bbb3b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:37.912524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae929ea-ae37-47bd-933d-cc214bbb3b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.912812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae929ea-ae37-47bd-933d-cc214bbb3b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.913088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae929ea-ae37-47bd-933d-cc214bbb3b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.913885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae929ea-ae37-47bd-933d-cc214bbb3b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:37.916012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae929ea-ae37-47bd-933d-cc214bbb3b11 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:37.919022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f533eb5f-c9a8-4fb2-9f3e-52b2def0ace4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:37.920344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f533eb5f-c9a8-4fb2-9f3e-52b2def0ace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:37.934941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 789/1549] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:37.942021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6da481-de73-407d-9905-26e04132545f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:37.942431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6da481-de73-407d-9905-26e04132545f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:37.942822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6da481-de73-407d-9905-26e04132545f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:37.962185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 761/1550] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:37.964418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae929ea-ae37-47bd-933d-cc214bbb3b11 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:37.968178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9a6da481-de73-407d-9905-26e04132545f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:37.969625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9a6da481-de73-407d-9905-26e04132545f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.034075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae929ea-ae37-47bd-933d-cc214bbb3b11 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.038923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bf7a1-29b0-4e7b-94e1-5f3f165afbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.039604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bf7a1-29b0-4e7b-94e1-5f3f165afbbd admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.039888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bf7a1-29b0-4e7b-94e1-5f3f165afbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.040244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bf7a1-29b0-4e7b-94e1-5f3f165afbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.040932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bf7a1-29b0-4e7b-94e1-5f3f165afbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.042575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bf7a1-29b0-4e7b-94e1-5f3f165afbbd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.047070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 790/1551] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.048519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6d6c-4b58-401a-9e71-4265ed55cda3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.048810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6d6c-4b58-401a-9e71-4265ed55cda3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.049087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6d6c-4b58-401a-9e71-4265ed55cda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.055492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 762/1552] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:38.055492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aae09-5343-49e7-9c9a-c9764f16d3cc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.055492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aae09-5343-49e7-9c9a-c9764f16d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.055492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aae09-5343-49e7-9c9a-c9764f16d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.075058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7f4aae09-5343-49e7-9c9a-c9764f16d3cc None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.075520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b55f6d6c-4b58-401a-9e71-4265ed55cda3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.076587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7f4aae09-5343-49e7-9c9a-c9764f16d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.076910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b55f6d6c-4b58-401a-9e71-4265ed55cda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.085310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 791/1554] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.085481 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 763/1554] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.086640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e209e-91ba-4ea4-9b70-71157787e744 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.086931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e209e-91ba-4ea4-9b70-71157787e744 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.087208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e209e-91ba-4ea4-9b70-71157787e744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.088060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279837-4824-41a6-a374-f03c168dcb64 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.088925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279837-4824-41a6-a374-f03c168dcb64 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.089410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc279837-4824-41a6-a374-f03c168dcb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.106999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-db4e209e-91ba-4ea4-9b70-71157787e744 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.108252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-db4e209e-91ba-4ea4-9b70-71157787e744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.109382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cc279837-4824-41a6-a374-f03c168dcb64 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.110672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cc279837-4824-41a6-a374-f03c168dcb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.116808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 764/1555] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.118097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e209e-91ba-4ea4-9b70-71157787e744 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.123107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 792/1556] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.123107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1bf1-ffda-44a1-8479-eaba1ba4cd14 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.123107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1bf1-ffda-44a1-8479-eaba1ba4cd14 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.123107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1bf1-ffda-44a1-8479-eaba1ba4cd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.133528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e209e-91ba-4ea4-9b70-71157787e744 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.138460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dc17d-ae0c-41c3-b0d9-cd31a4a39647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.139141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc17d-ae0c-41c3-b0d9-cd31a4a39647 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.139424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc17d-ae0c-41c3-b0d9-cd31a4a39647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.139544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e7dd1bf1-ffda-44a1-8479-eaba1ba4cd14 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.139692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dc17d-ae0c-41c3-b0d9-cd31a4a39647 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.140435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dc17d-ae0c-41c3-b0d9-cd31a4a39647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.140806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e7dd1bf1-ffda-44a1-8479-eaba1ba4cd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.142397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dc17d-ae0c-41c3-b0d9-cd31a4a39647 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.150381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 793/1557] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.152455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbebee-0015-46a2-b749-d84cbff63ea6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.152758 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbebee-0015-46a2-b749-d84cbff63ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.153036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbebee-0015-46a2-b749-d84cbff63ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.153982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:38.173876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 765/1558] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/users => generated 291 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:38.173876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dc17d-ae0c-41c3-b0d9-cd31a4a39647 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.180466 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c5cbebee-0015-46a2-b749-d84cbff63ea6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.181678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c5cbebee-0015-46a2-b749-d84cbff63ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.184232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dc17d-ae0c-41c3-b0d9-cd31a4a39647 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.188986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce534c-ac1d-4c1a-b9c2-a6d1b7f26ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.189659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce534c-ac1d-4c1a-b9c2-a6d1b7f26ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.189931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce534c-ac1d-4c1a-b9c2-a6d1b7f26ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.190203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce534c-ac1d-4c1a-b9c2-a6d1b7f26ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.190934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce534c-ac1d-4c1a-b9c2-a6d1b7f26ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.191565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 794/1559] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.192439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbebee-0015-46a2-b749-d84cbff63ea6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.192658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce534c-ac1d-4c1a-b9c2-a6d1b7f26ae7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.203244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbebee-0015-46a2-b749-d84cbff63ea6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.204824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 766/1560] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:38.206456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908528b-afd8-4c71-9e4e-da11f9388429 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.206755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908528b-afd8-4c71-9e4e-da11f9388429 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.207032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908528b-afd8-4c71-9e4e-da11f9388429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.208367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.208916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.209201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.209476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.210205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:38.210530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.212129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.232197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 795/1561] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:38.232197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.236735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20397110-932c-42c2-960d-6bc6c895a1f4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.237765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1908528b-afd8-4c71-9e4e-da11f9388429 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.239491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1908528b-afd8-4c71-9e4e-da11f9388429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.241496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9b3f5-e10b-4056-a6c0-df61d8b5bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.242166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9b3f5-e10b-4056-a6c0-df61d8b5bc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.242457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9b3f5-e10b-4056-a6c0-df61d8b5bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.242736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9b3f5-e10b-4056-a6c0-df61d8b5bc26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.243469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9b3f5-e10b-4056-a6c0-df61d8b5bc26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:38.243782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9b3f5-e10b-4056-a6c0-df61d8b5bc26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.245423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9b3f5-e10b-4056-a6c0-df61d8b5bc26 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.253161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 767/1562] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.253363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:38.255414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbd201-8ddb-4e41-8de1-0cad0ad4d22b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.255973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbd201-8ddb-4e41-8de1-0cad0ad4d22b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.256864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbd201-8ddb-4e41-8de1-0cad0ad4d22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.263391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 796/1563] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:38.265110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ed0d-039f-47a6-aa3d-e762f0492d3c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.265402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ed0d-039f-47a6-aa3d-e762f0492d3c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.265677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ed0d-039f-47a6-aa3d-e762f0492d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.288967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b722ed0d-039f-47a6-aa3d-e762f0492d3c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.290594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b722ed0d-039f-47a6-aa3d-e762f0492d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.293794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-04fbd201-8ddb-4e41-8de1-0cad0ad4d22b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.296150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-04fbd201-8ddb-4e41-8de1-0cad0ad4d22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.303939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 797/1564] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.303939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ed0d-039f-47a6-aa3d-e762f0492d3c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.311852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 768/1565] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.312079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ed0d-039f-47a6-aa3d-e762f0492d3c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.313108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbd201-8ddb-4e41-8de1-0cad0ad4d22b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.317736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743ae72-a064-486f-9c94-78a0920fe093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.318662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743ae72-a064-486f-9c94-78a0920fe093 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.319048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743ae72-a064-486f-9c94-78a0920fe093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.319426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743ae72-a064-486f-9c94-78a0920fe093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.320907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743ae72-a064-486f-9c94-78a0920fe093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.323481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743ae72-a064-486f-9c94-78a0920fe093 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.324745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbd201-8ddb-4e41-8de1-0cad0ad4d22b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.329843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.330525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.330953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.331341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.332108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:38.332441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.334072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.336437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 798/1566] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:38.337252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743ae72-a064-486f-9c94-78a0920fe093 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.348257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743ae72-a064-486f-9c94-78a0920fe093 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.351520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 769/1567] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:38.356470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.357941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439756b5-14b4-4af9-bcb8-ddeeeab8e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.359668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439756b5-14b4-4af9-bcb8-ddeeeab8e1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.359960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439756b5-14b4-4af9-bcb8-ddeeeab8e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.360453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439756b5-14b4-4af9-bcb8-ddeeeab8e1c0 admin admin] PATH_INFO: `/v3/projects/57403cb3141e476e8ba23288e24e5643/users/278de58f2ec74ec1a632f875ee886a4d/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.362921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7b844-d792-48b1-89b6-a3c957f0e1ca admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.369381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9abb-b5bc-4b5e-bcb0-e610a3860e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.370468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9abb-b5bc-4b5e-bcb0-e610a3860e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.370808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9abb-b5bc-4b5e-bcb0-e610a3860e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.371127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9abb-b5bc-4b5e-bcb0-e610a3860e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.372134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd9abb-b5bc-4b5e-bcb0-e610a3860e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.374855 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd9abb-b5bc-4b5e-bcb0-e610a3860e4f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.377376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439756b5-14b4-4af9-bcb8-ddeeeab8e1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57403cb3141e476e8ba23288e24e5643, user_id=278de58f2ec74ec1a632f875ee886a4d, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.380058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439756b5-14b4-4af9-bcb8-ddeeeab8e1c0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.396224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 799/1568] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:38 2022] PUT /identity/v3/projects/57403cb3141e476e8ba23288e24e5643/users/278de58f2ec74ec1a632f875ee886a4d/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:38.397112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439756b5-14b4-4af9-bcb8-ddeeeab8e1c0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.428153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 770/1569] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:38.428153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9abb-b5bc-4b5e-bcb0-e610a3860e4f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.489488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439756b5-14b4-4af9-bcb8-ddeeeab8e1c0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.502163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9abb-b5bc-4b5e-bcb0-e610a3860e4f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.507179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8da850-80cb-4119-885f-0e990242151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.507845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8da850-80cb-4119-885f-0e990242151b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.508148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8da850-80cb-4119-885f-0e990242151b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.508423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8da850-80cb-4119-885f-0e990242151b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.509120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8da850-80cb-4119-885f-0e990242151b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.511985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8da850-80cb-4119-885f-0e990242151b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.547756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 771/1570] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:38.547756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8da850-80cb-4119-885f-0e990242151b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.560096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.561021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.561151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.561338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.562074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:38.562385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.564002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.582996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 800/1571] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:38.582996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.589239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe43643-43d5-47a1-a979-642416645244 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.609008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8da850-80cb-4119-885f-0e990242151b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.613711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.614395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.614659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.614937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.615662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:38.616080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.617723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.630358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 772/1572] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:38.631314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.641046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2596-400c-47e3-b8fc-59af4d03e497 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.643757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:38.645807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed22327-eb65-404c-89b2-9c1787aeb1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.646550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed22327-eb65-404c-89b2-9c1787aeb1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.646823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed22327-eb65-404c-89b2-9c1787aeb1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.647098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed22327-eb65-404c-89b2-9c1787aeb1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.647821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed22327-eb65-404c-89b2-9c1787aeb1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.649469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed22327-eb65-404c-89b2-9c1787aeb1b1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.654214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e8ec0-43f6-4964-9206-f78a9ba9c676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.655653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8ec0-43f6-4964-9206-f78a9ba9c676 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.656126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8ec0-43f6-4964-9206-f78a9ba9c676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.656634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e8ec0-43f6-4964-9206-f78a9ba9c676 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.657957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e8ec0-43f6-4964-9206-f78a9ba9c676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:38.658496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e8ec0-43f6-4964-9206-f78a9ba9c676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.661346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 773/1573] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:38.661560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e8ec0-43f6-4964-9206-f78a9ba9c676 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.662132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed22327-eb65-404c-89b2-9c1787aeb1b1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.667689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:38.673285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed22327-eb65-404c-89b2-9c1787aeb1b1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.677170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 801/1574] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:38.677170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de008b1-6d58-4d6f-b387-3f8898837b09 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.677170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de008b1-6d58-4d6f-b387-3f8898837b09 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.677170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de008b1-6d58-4d6f-b387-3f8898837b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.684565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715890-5ac6-44fc-96cc-2f2bc4a1b6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.684565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715890-5ac6-44fc-96cc-2f2bc4a1b6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.684565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715890-5ac6-44fc-96cc-2f2bc4a1b6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.684565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715890-5ac6-44fc-96cc-2f2bc4a1b6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.684884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8715890-5ac6-44fc-96cc-2f2bc4a1b6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.684884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8715890-5ac6-44fc-96cc-2f2bc4a1b6b2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.706526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8de008b1-6d58-4d6f-b387-3f8898837b09 None None] MFA Rules not processed for user `278de58f2ec74ec1a632f875ee886a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:38.707756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8de008b1-6d58-4d6f-b387-3f8898837b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:38.715719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 774/1575] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:38.715719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715890-5ac6-44fc-96cc-2f2bc4a1b6b2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.783771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 802/1576] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:38.788287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715890-5ac6-44fc-96cc-2f2bc4a1b6b2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.788431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de008b1-6d58-4d6f-b387-3f8898837b09 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.789845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca87472-0824-4350-a252-ebc98c038105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.790524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca87472-0824-4350-a252-ebc98c038105 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.790810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca87472-0824-4350-a252-ebc98c038105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.791088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca87472-0824-4350-a252-ebc98c038105 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.791804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca87472-0824-4350-a252-ebc98c038105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.793807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca87472-0824-4350-a252-ebc98c038105 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.801620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de008b1-6d58-4d6f-b387-3f8898837b09 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.807429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63df6-8f3c-410b-8024-83bd15b0357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.808291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63df6-8f3c-410b-8024-83bd15b0357d admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.808681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63df6-8f3c-410b-8024-83bd15b0357d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.809003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63df6-8f3c-410b-8024-83bd15b0357d admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.809840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a63df6-8f3c-410b-8024-83bd15b0357d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.812134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a63df6-8f3c-410b-8024-83bd15b0357d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.818147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 775/1577] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:38.819092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca87472-0824-4350-a252-ebc98c038105 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.831296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca87472-0824-4350-a252-ebc98c038105 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.836651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999cd1-5dc9-4a3b-a9eb-b57f9b01a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.837251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 803/1578] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/users => generated 284 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:38.837408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999cd1-5dc9-4a3b-a9eb-b57f9b01a5ee admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.837585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999cd1-5dc9-4a3b-a9eb-b57f9b01a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.837861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999cd1-5dc9-4a3b-a9eb-b57f9b01a5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.838534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63df6-8f3c-410b-8024-83bd15b0357d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.838651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999cd1-5dc9-4a3b-a9eb-b57f9b01a5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.840568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999cd1-5dc9-4a3b-a9eb-b57f9b01a5ee admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.848754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63df6-8f3c-410b-8024-83bd15b0357d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.853691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096c367-9018-4d31-9bcf-253c223ce85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.854963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096c367-9018-4d31-9bcf-253c223ce85c admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.855248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096c367-9018-4d31-9bcf-253c223ce85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.855518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096c367-9018-4d31-9bcf-253c223ce85c admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.856346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096c367-9018-4d31-9bcf-253c223ce85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.858271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096c367-9018-4d31-9bcf-253c223ce85c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.871900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 776/1579] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:38.871900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999cd1-5dc9-4a3b-a9eb-b57f9b01a5ee admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.888885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 804/1580] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:38.889473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096c367-9018-4d31-9bcf-253c223ce85c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:38.938216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999cd1-5dc9-4a3b-a9eb-b57f9b01a5ee admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.959070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096c367-9018-4d31-9bcf-253c223ce85c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:38.964655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8a941-2f97-45bc-adc0-4705e9b5099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:38.965315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a941-2f97-45bc-adc0-4705e9b5099f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:38.965598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a941-2f97-45bc-adc0-4705e9b5099f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:38.965872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8a941-2f97-45bc-adc0-4705e9b5099f admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:38.966557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8a941-2f97-45bc-adc0-4705e9b5099f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:38.968556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8a941-2f97-45bc-adc0-4705e9b5099f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:38.997669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:39.003265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 805/1581] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:38 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:39.004437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8a941-2f97-45bc-adc0-4705e9b5099f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.010455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a20da-a383-4bcf-80e9-7de409e3fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.011602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a20da-a383-4bcf-80e9-7de409e3fcdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.012492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a20da-a383-4bcf-80e9-7de409e3fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.012791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a20da-a383-4bcf-80e9-7de409e3fcdf admin admin] PATH_INFO: `/v3/projects/905a18cfe99e430d81d9439ccb5194fc/users/219f991e9c7241178f1621f0d3932bd6/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.030406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a20da-a383-4bcf-80e9-7de409e3fcdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=905a18cfe99e430d81d9439ccb5194fc, user_id=219f991e9c7241178f1621f0d3932bd6, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.031467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-b01a20da-a383-4bcf-80e9-7de409e3fcdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:17:39.031467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Jul 14 11:17:39.031467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: Jul 14 11:17:39.033441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a20da-a383-4bcf-80e9-7de409e3fcdf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.038983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:39.048150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 777/1582] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:38 2022] PUT /identity/v3/projects/905a18cfe99e430d81d9439ccb5194fc/users/219f991e9c7241178f1621f0d3932bd6/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:39.049844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7b1d9-fca3-4e80-be8c-65c55c872b64 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.050147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7b1d9-fca3-4e80-be8c-65c55c872b64 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.050403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7b1d9-fca3-4e80-be8c-65c55c872b64 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.051655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 778/1583] 10.222.0.17 () {54 vars in 961 bytes} [Thu Jul 14 11:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:17:39.052564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7b1d9-fca3-4e80-be8c-65c55c872b64 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.085437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8a941-2f97-45bc-adc0-4705e9b5099f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.116397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7b1d9-fca3-4e80-be8c-65c55c872b64 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.121189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca5cb5-68b6-4862-aa1e-814cd06eea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.121861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca5cb5-68b6-4862-aa1e-814cd06eea8a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.122134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca5cb5-68b6-4862-aa1e-814cd06eea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.122405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca5cb5-68b6-4862-aa1e-814cd06eea8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.123120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca5cb5-68b6-4862-aa1e-814cd06eea8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.124753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca5cb5-68b6-4862-aa1e-814cd06eea8a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.134895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 779/1584] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.136562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca5cb5-68b6-4862-aa1e-814cd06eea8a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.142989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac69dde-6181-4e02-bf27-155bcea41efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.143662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac69dde-6181-4e02-bf27-155bcea41efa admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.143949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac69dde-6181-4e02-bf27-155bcea41efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.144255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac69dde-6181-4e02-bf27-155bcea41efa admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.144951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac69dde-6181-4e02-bf27-155bcea41efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.146890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac69dde-6181-4e02-bf27-155bcea41efa admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.147703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca5cb5-68b6-4862-aa1e-814cd06eea8a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.153075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e27ed-c866-4014-8e94-d4d9e72e1486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.153723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e27ed-c866-4014-8e94-d4d9e72e1486 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.154001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e27ed-c866-4014-8e94-d4d9e72e1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.154274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e27ed-c866-4014-8e94-d4d9e72e1486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.154990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e27ed-c866-4014-8e94-d4d9e72e1486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.156651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e27ed-c866-4014-8e94-d4d9e72e1486 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.168350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 806/1586] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:39.168586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 780/1586] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.169259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac69dde-6181-4e02-bf27-155bcea41efa admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.169372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e27ed-c866-4014-8e94-d4d9e72e1486 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.179621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e27ed-c866-4014-8e94-d4d9e72e1486 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.181128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac69dde-6181-4e02-bf27-155bcea41efa admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.184249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96313be-0a99-4677-a897-1146556dde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.184907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96313be-0a99-4677-a897-1146556dde90 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.185188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96313be-0a99-4677-a897-1146556dde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.185515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96313be-0a99-4677-a897-1146556dde90 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.186205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727cd49-d4fa-484a-bebb-fe633e0857f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.186382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96313be-0a99-4677-a897-1146556dde90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.187056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727cd49-d4fa-484a-bebb-fe633e0857f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.187380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727cd49-d4fa-484a-bebb-fe633e0857f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.187980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727cd49-d4fa-484a-bebb-fe633e0857f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.188339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96313be-0a99-4677-a897-1146556dde90 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.189310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727cd49-d4fa-484a-bebb-fe633e0857f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.191732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727cd49-d4fa-484a-bebb-fe633e0857f0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.211600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 781/1587] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/users => generated 282 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:39.212695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96313be-0a99-4677-a897-1146556dde90 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.216375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 807/1588] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/users => generated 290 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:39.223839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e07b-d835-4fea-b52d-cfba06c7288c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.223839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e07b-d835-4fea-b52d-cfba06c7288c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.223839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3e07b-d835-4fea-b52d-cfba06c7288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.224439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96313be-0a99-4677-a897-1146556dde90 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.229165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c50db0-3fba-4655-a9c3-8b8348439083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.229904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50db0-3fba-4655-a9c3-8b8348439083 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.230196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50db0-3fba-4655-a9c3-8b8348439083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.230486 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c50db0-3fba-4655-a9c3-8b8348439083 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.231164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c50db0-3fba-4655-a9c3-8b8348439083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.233136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c50db0-3fba-4655-a9c3-8b8348439083 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.256969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 782/1589] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:39.262130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c35d6-45a5-42f6-985b-e2ecc476c143 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.262417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c35d6-45a5-42f6-985b-e2ecc476c143 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.262723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c35d6-45a5-42f6-985b-e2ecc476c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.264157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f2a3e07b-d835-4fea-b52d-cfba06c7288c None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:39.265603 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f2a3e07b-d835-4fea-b52d-cfba06c7288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:39.290859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-292c35d6-45a5-42f6-985b-e2ecc476c143 None None] MFA Rules not processed for user `219f991e9c7241178f1621f0d3932bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:39.292243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-292c35d6-45a5-42f6-985b-e2ecc476c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:39.335707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 808/1590] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:39.336602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e07b-d835-4fea-b52d-cfba06c7288c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.347523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3e07b-d835-4fea-b52d-cfba06c7288c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.352150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b59c4d-bfd8-49dd-9a35-059ee2d812f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.352820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b59c4d-bfd8-49dd-9a35-059ee2d812f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.353107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b59c4d-bfd8-49dd-9a35-059ee2d812f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.353383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b59c4d-bfd8-49dd-9a35-059ee2d812f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.354686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b59c4d-bfd8-49dd-9a35-059ee2d812f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.356330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b59c4d-bfd8-49dd-9a35-059ee2d812f4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.361254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 783/1591] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:39.362098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c35d6-45a5-42f6-985b-e2ecc476c143 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.373234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 809/1592] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.373234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b59c4d-bfd8-49dd-9a35-059ee2d812f4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.373512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c35d6-45a5-42f6-985b-e2ecc476c143 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.376636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108551a6-2b08-4db9-85d7-6a2ab7aea08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.377298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108551a6-2b08-4db9-85d7-6a2ab7aea08c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.377579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108551a6-2b08-4db9-85d7-6a2ab7aea08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.377855 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108551a6-2b08-4db9-85d7-6a2ab7aea08c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.378579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108551a6-2b08-4db9-85d7-6a2ab7aea08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.380207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108551a6-2b08-4db9-85d7-6a2ab7aea08c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.381157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b59c4d-bfd8-49dd-9a35-059ee2d812f4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.386320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b97f-1071-4f3e-8d42-d8e6eceffac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.386971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b97f-1071-4f3e-8d42-d8e6eceffac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.387282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b97f-1071-4f3e-8d42-d8e6eceffac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.387538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540b97f-1071-4f3e-8d42-d8e6eceffac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.388296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540b97f-1071-4f3e-8d42-d8e6eceffac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.389889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540b97f-1071-4f3e-8d42-d8e6eceffac1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.393557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 784/1593] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.393557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108551a6-2b08-4db9-85d7-6a2ab7aea08c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.400579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 810/1594] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.401749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b97f-1071-4f3e-8d42-d8e6eceffac1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.403752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108551a6-2b08-4db9-85d7-6a2ab7aea08c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.406677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:39.408982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801566d3-d9da-4eca-8b97-5cf20a7fe7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.409677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801566d3-d9da-4eca-8b97-5cf20a7fe7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.409963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801566d3-d9da-4eca-8b97-5cf20a7fe7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.410268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801566d3-d9da-4eca-8b97-5cf20a7fe7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.411211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801566d3-d9da-4eca-8b97-5cf20a7fe7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.412903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801566d3-d9da-4eca-8b97-5cf20a7fe7ae admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.413695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540b97f-1071-4f3e-8d42-d8e6eceffac1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.414692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:39.419687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf2a5-cbf5-4246-b851-a8552c67e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.420560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf2a5-cbf5-4246-b851-a8552c67e645 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.420952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf2a5-cbf5-4246-b851-a8552c67e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.421354 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf2a5-cbf5-4246-b851-a8552c67e645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.422184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf2a5-cbf5-4246-b851-a8552c67e645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.423869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf2a5-cbf5-4246-b851-a8552c67e645 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.426495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 785/1595] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.427375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801566d3-d9da-4eca-8b97-5cf20a7fe7ae admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.438625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 811/1596] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.438625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf2a5-cbf5-4246-b851-a8552c67e645 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.438890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801566d3-d9da-4eca-8b97-5cf20a7fe7ae admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.442467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8c046-34ad-4249-922c-03b8f098cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.443340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8c046-34ad-4249-922c-03b8f098cfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.443634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8c046-34ad-4249-922c-03b8f098cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.443912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8c046-34ad-4249-922c-03b8f098cfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.444690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8c046-34ad-4249-922c-03b8f098cfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.446287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8c046-34ad-4249-922c-03b8f098cfc6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.448963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf2a5-cbf5-4246-b851-a8552c67e645 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.454716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c764-3df4-4784-beb8-55a806d8dc94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.455346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c764-3df4-4784-beb8-55a806d8dc94 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.455631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c764-3df4-4784-beb8-55a806d8dc94 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.455908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24c764-3df4-4784-beb8-55a806d8dc94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.457804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 786/1597] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.458444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8c046-34ad-4249-922c-03b8f098cfc6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.468661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8c046-34ad-4249-922c-03b8f098cfc6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.474782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670434b-561b-4c96-848e-72f6d2ae1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.475652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670434b-561b-4c96-848e-72f6d2ae1438 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.475951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670434b-561b-4c96-848e-72f6d2ae1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.476263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670434b-561b-4c96-848e-72f6d2ae1438 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.476959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670434b-561b-4c96-848e-72f6d2ae1438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.479532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c670434b-561b-4c96-848e-72f6d2ae1438 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.512891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 787/1598] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:39.512891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670434b-561b-4c96-848e-72f6d2ae1438 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.520301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24c764-3df4-4784-beb8-55a806d8dc94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.521994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24c764-3df4-4784-beb8-55a806d8dc94 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.532139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 812/1599] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:39.533043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c764-3df4-4784-beb8-55a806d8dc94 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.543378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24c764-3df4-4784-beb8-55a806d8dc94 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.595440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670434b-561b-4c96-848e-72f6d2ae1438 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.601437 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838a552-9691-4713-a384-64adfcf85ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.602352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838a552-9691-4713-a384-64adfcf85ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.602640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838a552-9691-4713-a384-64adfcf85ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.602917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838a552-9691-4713-a384-64adfcf85ccb admin admin] PATH_INFO: `/v3/projects/9d6321d39500480a84ad13d436a6b73a/users/4399658c6afd4afdb0bbca33db91b80b/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.611240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a88d7d-8e4b-4bb1-b51e-212bda39f63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.612663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a88d7d-8e4b-4bb1-b51e-212bda39f63a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.613021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a88d7d-8e4b-4bb1-b51e-212bda39f63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.613363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a88d7d-8e4b-4bb1-b51e-212bda39f63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.614337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a88d7d-8e4b-4bb1-b51e-212bda39f63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.616072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a88d7d-8e4b-4bb1-b51e-212bda39f63a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.619198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838a552-9691-4713-a384-64adfcf85ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6321d39500480a84ad13d436a6b73a, user_id=4399658c6afd4afdb0bbca33db91b80b, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.622265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838a552-9691-4713-a384-64adfcf85ccb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.628219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 813/1600] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.628505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a88d7d-8e4b-4bb1-b51e-212bda39f63a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.643784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 788/1601] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:39 2022] PUT /identity/v3/projects/9d6321d39500480a84ad13d436a6b73a/users/4399658c6afd4afdb0bbca33db91b80b/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:39.643784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838a552-9691-4713-a384-64adfcf85ccb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.644081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a88d7d-8e4b-4bb1-b51e-212bda39f63a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.714999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b558e2e-9f41-4532-b90c-6b1b8440a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.715946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b558e2e-9f41-4532-b90c-6b1b8440a158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.716298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b558e2e-9f41-4532-b90c-6b1b8440a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.716637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b558e2e-9f41-4532-b90c-6b1b8440a158 admin admin] PATH_INFO: `/v3/projects/9a607defd93e446ebef41a9a497145cb/users/f694ba79cb6c4e9b83d4d565b381ab01/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.727447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838a552-9691-4713-a384-64adfcf85ccb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.733422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9110f7d-8485-44c6-9342-a36d6575e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.734143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110f7d-8485-44c6-9342-a36d6575e3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.734421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110f7d-8485-44c6-9342-a36d6575e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.734701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110f7d-8485-44c6-9342-a36d6575e3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.735430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9110f7d-8485-44c6-9342-a36d6575e3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.737100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9110f7d-8485-44c6-9342-a36d6575e3bc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.739131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b558e2e-9f41-4532-b90c-6b1b8440a158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a607defd93e446ebef41a9a497145cb, user_id=f694ba79cb6c4e9b83d4d565b381ab01, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.742410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b558e2e-9f41-4532-b90c-6b1b8440a158 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.750220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 789/1602] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.751275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9110f7d-8485-44c6-9342-a36d6575e3bc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.763298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9110f7d-8485-44c6-9342-a36d6575e3bc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.766832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 814/1603] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:39 2022] PUT /identity/v3/projects/9a607defd93e446ebef41a9a497145cb/users/f694ba79cb6c4e9b83d4d565b381ab01/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:39.767676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b558e2e-9f41-4532-b90c-6b1b8440a158 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.790912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:39.830045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:39.849100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e43d5-a782-4756-a14c-453e6930d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.849779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e43d5-a782-4756-a14c-453e6930d2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.850054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e43d5-a782-4756-a14c-453e6930d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.850355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e43d5-a782-4756-a14c-453e6930d2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.851171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e43d5-a782-4756-a14c-453e6930d2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.853124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e43d5-a782-4756-a14c-453e6930d2e6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.857068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b558e2e-9f41-4532-b90c-6b1b8440a158 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.862072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a196c-b72d-42fc-8b11-b5945ef63025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.862761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a196c-b72d-42fc-8b11-b5945ef63025 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.863044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a196c-b72d-42fc-8b11-b5945ef63025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.863328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a196c-b72d-42fc-8b11-b5945ef63025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.864074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a196c-b72d-42fc-8b11-b5945ef63025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.864564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 790/1604] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.865397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e43d5-a782-4756-a14c-453e6930d2e6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.870027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a196c-b72d-42fc-8b11-b5945ef63025 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.876611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e43d5-a782-4756-a14c-453e6930d2e6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.884200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 815/1605] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:39.884397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0717a-bfe4-423f-aee9-277b896e43a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.884397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0717a-bfe4-423f-aee9-277b896e43a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.884571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a196c-b72d-42fc-8b11-b5945ef63025 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.884647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0717a-bfe4-423f-aee9-277b896e43a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.884647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0717a-bfe4-423f-aee9-277b896e43a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.884647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0717a-bfe4-423f-aee9-277b896e43a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.885806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0717a-bfe4-423f-aee9-277b896e43a0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.892777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a196c-b72d-42fc-8b11-b5945ef63025 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:39.897586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9de54-9435-4a69-a0cd-95563dd659ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:39.898619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9de54-9435-4a69-a0cd-95563dd659ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.898920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9de54-9435-4a69-a0cd-95563dd659ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.899188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9de54-9435-4a69-a0cd-95563dd659ba admin admin] PATH_INFO: `/v3/projects/1bb35ae08d74495a90816bd8ce7d74d6/users/7662e6490c3442e4800a0c6b96de3081/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.914865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 791/1606] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:39.916141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9de54-9435-4a69-a0cd-95563dd659ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb35ae08d74495a90816bd8ce7d74d6, user_id=7662e6490c3442e4800a0c6b96de3081, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:39.917116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084d594-0d91-450d-9427-7017218c5a69 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:39.917434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084d594-0d91-450d-9427-7017218c5a69 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:39.917859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084d594-0d91-450d-9427-7017218c5a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:39.919356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9de54-9435-4a69-a0cd-95563dd659ba admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:39.934398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 816/1607] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:39 2022] PUT /identity/v3/projects/1bb35ae08d74495a90816bd8ce7d74d6/users/7662e6490c3442e4800a0c6b96de3081/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:39.935215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9de54-9435-4a69-a0cd-95563dd659ba admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:39.936437 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9084d594-0d91-450d-9427-7017218c5a69 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:39.937637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9084d594-0d91-450d-9427-7017218c5a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:40.000715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 792/1608] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:40.002096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec84a-d895-46ed-937e-708b12b45cd2 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.002514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec84a-d895-46ed-937e-708b12b45cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.002805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ec84a-d895-46ed-937e-708b12b45cd2 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.004608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 793/1609] 10.222.0.17 () {54 vars in 912 bytes} [Thu Jul 14 11:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:17:40.005386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9de54-9435-4a69-a0cd-95563dd659ba admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.009116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b354-138d-459e-ba15-a5b4a16cb6db None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.009418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b354-138d-459e-ba15-a5b4a16cb6db None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.009680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383b354-138d-459e-ba15-a5b4a16cb6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.011752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cba0a6-71e9-4418-bafc-025a126989f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.012754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba0a6-71e9-4418-bafc-025a126989f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.013126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba0a6-71e9-4418-bafc-025a126989f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.013471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cba0a6-71e9-4418-bafc-025a126989f6 admin admin] PATH_INFO: `/v3/projects/556f85965f6c47619c1a954a2e439d63/users/aff441788c2b48afbf227215789147e5/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.029637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cba0a6-71e9-4418-bafc-025a126989f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556f85965f6c47619c1a954a2e439d63, user_id=aff441788c2b48afbf227215789147e5, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.032307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cba0a6-71e9-4418-bafc-025a126989f6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.038749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b383b354-138d-459e-ba15-a5b4a16cb6db None None] MFA Rules not processed for user `f694ba79cb6c4e9b83d4d565b381ab01`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:40.040079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b383b354-138d-459e-ba15-a5b4a16cb6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:40.047089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 817/1610] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:39 2022] PUT /identity/v3/projects/556f85965f6c47619c1a954a2e439d63/users/aff441788c2b48afbf227215789147e5/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:40.048128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cba0a6-71e9-4418-bafc-025a126989f6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.108986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 794/1611] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:40.109914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383b354-138d-459e-ba15-a5b4a16cb6db None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.118678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cba0a6-71e9-4418-bafc-025a126989f6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.120872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383b354-138d-459e-ba15-a5b4a16cb6db None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.124386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba50a00-b5a7-4a12-8844-82ba3d24d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.125314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba50a00-b5a7-4a12-8844-82ba3d24d125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.125584 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba50a00-b5a7-4a12-8844-82ba3d24d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.125839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e9d1a-2493-4baf-8dd4-c054adbe6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.125967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba50a00-b5a7-4a12-8844-82ba3d24d125 admin admin] PATH_INFO: `/v3/projects/774544813e74450f89e01104db354406/users/c2802dc1edb54153ad2c0e2751563489/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.126902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9d1a-2493-4baf-8dd4-c054adbe6823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.127243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9d1a-2493-4baf-8dd4-c054adbe6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.127583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e9d1a-2493-4baf-8dd4-c054adbe6823 admin admin] PATH_INFO: `/v3/projects/b01e295c30494db9a4386e871e6d9dcc/users/f38b26b3a2b6480ead16fb239b327d1f/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.136179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:40.144549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9d1a-2493-4baf-8dd4-c054adbe6823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01e295c30494db9a4386e871e6d9dcc, user_id=f38b26b3a2b6480ead16fb239b327d1f, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.144987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba50a00-b5a7-4a12-8844-82ba3d24d125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774544813e74450f89e01104db354406, user_id=c2802dc1edb54153ad2c0e2751563489, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.147262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e9d1a-2493-4baf-8dd4-c054adbe6823 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.147657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba50a00-b5a7-4a12-8844-82ba3d24d125 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.160004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 795/1612] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:40 2022] PUT /identity/v3/projects/b01e295c30494db9a4386e871e6d9dcc/users/f38b26b3a2b6480ead16fb239b327d1f/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:40.163646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 818/1613] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:40 2022] PUT /identity/v3/projects/774544813e74450f89e01104db354406/users/c2802dc1edb54153ad2c0e2751563489/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:40.163646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba50a00-b5a7-4a12-8844-82ba3d24d125 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.165257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4414-61b5-4083-a8c7-4a2e1d20bb64 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.165547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4414-61b5-4083-a8c7-4a2e1d20bb64 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.165820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4414-61b5-4083-a8c7-4a2e1d20bb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.191653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-739e4414-61b5-4083-a8c7-4a2e1d20bb64 None None] MFA Rules not processed for user `7662e6490c3442e4800a0c6b96de3081`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:40.192907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-739e4414-61b5-4083-a8c7-4a2e1d20bb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:40.207123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:40.225009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba50a00-b5a7-4a12-8844-82ba3d24d125 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.229951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb5e30-f193-460b-9282-ac6e93b32541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.230638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5e30-f193-460b-9282-ac6e93b32541 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.230955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5e30-f193-460b-9282-ac6e93b32541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.231268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5e30-f193-460b-9282-ac6e93b32541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.232008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb5e30-f193-460b-9282-ac6e93b32541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.233700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb5e30-f193-460b-9282-ac6e93b32541 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.248067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 819/1614] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:40.248067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcebba1-d4e7-4b38-8ff6-a16593dd0db0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.248067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcebba1-d4e7-4b38-8ff6-a16593dd0db0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.248067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcebba1-d4e7-4b38-8ff6-a16593dd0db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.266057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 796/1615] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:40.266849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4414-61b5-4083-a8c7-4a2e1d20bb64 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.271716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5dcebba1-d4e7-4b38-8ff6-a16593dd0db0 None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:40.272965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5dcebba1-d4e7-4b38-8ff6-a16593dd0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:40.321113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4414-61b5-4083-a8c7-4a2e1d20bb64 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.327501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cba03-2731-4eee-b90a-32b40b1d2083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.328280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cba03-2731-4eee-b90a-32b40b1d2083 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.328635 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cba03-2731-4eee-b90a-32b40b1d2083 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.328984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cba03-2731-4eee-b90a-32b40b1d2083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.339225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cba03-2731-4eee-b90a-32b40b1d2083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.340709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cba03-2731-4eee-b90a-32b40b1d2083 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.343058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 820/1616] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:40.346162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47f988-9223-41a4-ad0f-e5a28bdc588b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.346489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47f988-9223-41a4-ad0f-e5a28bdc588b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.346793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47f988-9223-41a4-ad0f-e5a28bdc588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.351067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 797/1617] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:40.352173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cba03-2731-4eee-b90a-32b40b1d2083 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.376443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6f47f988-9223-41a4-ad0f-e5a28bdc588b None None] MFA Rules not processed for user `aff441788c2b48afbf227215789147e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:40.377739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6f47f988-9223-41a4-ad0f-e5a28bdc588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:40.413952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cba03-2731-4eee-b90a-32b40b1d2083 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.418022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0dd2f-3d7e-477d-9c5d-e5359ab70cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.418698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0dd2f-3d7e-477d-9c5d-e5359ab70cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.419121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0dd2f-3d7e-477d-9c5d-e5359ab70cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.419238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0dd2f-3d7e-477d-9c5d-e5359ab70cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.449158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 821/1618] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:40.450409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c91c31-4c8b-4e0c-9b53-b8ad2ac7064b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.450701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c91c31-4c8b-4e0c-9b53-b8ad2ac7064b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.451272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c91c31-4c8b-4e0c-9b53-b8ad2ac7064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.459163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:40.473374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-79c91c31-4c8b-4e0c-9b53-b8ad2ac7064b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:40.474842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-79c91c31-4c8b-4e0c-9b53-b8ad2ac7064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:40.484471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 822/1619] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:40.486622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448cf49-c60f-444a-a85f-88e53a4e0f3d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.486955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448cf49-c60f-444a-a85f-88e53a4e0f3d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.487273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448cf49-c60f-444a-a85f-88e53a4e0f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.496759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0dd2f-3d7e-477d-9c5d-e5359ab70cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.498313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0dd2f-3d7e-477d-9c5d-e5359ab70cf2 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.505553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3448cf49-c60f-444a-a85f-88e53a4e0f3d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:40.506861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3448cf49-c60f-444a-a85f-88e53a4e0f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:40.508479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 798/1620] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:40.511697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0dd2f-3d7e-477d-9c5d-e5359ab70cf2 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.520269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 823/1621] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:40.521178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448cf49-c60f-444a-a85f-88e53a4e0f3d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.536162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448cf49-c60f-444a-a85f-88e53a4e0f3d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.539970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0dd2f-3d7e-477d-9c5d-e5359ab70cf2 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.541026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496fe7b-834f-4eaf-8569-640b042b5127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.542431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496fe7b-834f-4eaf-8569-640b042b5127 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.542673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496fe7b-834f-4eaf-8569-640b042b5127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.542955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496fe7b-834f-4eaf-8569-640b042b5127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.543768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496fe7b-834f-4eaf-8569-640b042b5127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.546155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496fe7b-834f-4eaf-8569-640b042b5127 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.547167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59deca-c5fb-4e8c-adae-63d53479ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.548268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59deca-c5fb-4e8c-adae-63d53479ac8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.548688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59deca-c5fb-4e8c-adae-63d53479ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.549063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59deca-c5fb-4e8c-adae-63d53479ac8e admin admin] PATH_INFO: `/v3/projects/691ff9e915804315b48d8f3a52262a5e/users/4e3684c487c547bc8194302d4f249b4f/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.565026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:40.573516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59deca-c5fb-4e8c-adae-63d53479ac8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=691ff9e915804315b48d8f3a52262a5e, user_id=4e3684c487c547bc8194302d4f249b4f, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.579328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59deca-c5fb-4e8c-adae-63d53479ac8e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.584286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 824/1622] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:40.586770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496fe7b-834f-4eaf-8569-640b042b5127 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.606297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 799/1623] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:40 2022] PUT /identity/v3/projects/691ff9e915804315b48d8f3a52262a5e/users/4e3684c487c547bc8194302d4f249b4f/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:40.607957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59deca-c5fb-4e8c-adae-63d53479ac8e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.684155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496fe7b-834f-4eaf-8569-640b042b5127 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.692874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59deca-c5fb-4e8c-adae-63d53479ac8e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.699146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061a7ac-5e2d-4bb1-b812-a4085d6f4615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.700237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061a7ac-5e2d-4bb1-b812-a4085d6f4615 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.700531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061a7ac-5e2d-4bb1-b812-a4085d6f4615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.701518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061a7ac-5e2d-4bb1-b812-a4085d6f4615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.702564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061a7ac-5e2d-4bb1-b812-a4085d6f4615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.704393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061a7ac-5e2d-4bb1-b812-a4085d6f4615 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.753315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 800/1624] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:40.753315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061a7ac-5e2d-4bb1-b812-a4085d6f4615 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.756894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1cd6b-3b21-4771-98c1-5d86d1edcf8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.757562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1cd6b-3b21-4771-98c1-5d86d1edcf8c service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.757844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1cd6b-3b21-4771-98c1-5d86d1edcf8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.758120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1cd6b-3b21-4771-98c1-5d86d1edcf8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.873650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061a7ac-5e2d-4bb1-b812-a4085d6f4615 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.879541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d15cd-729d-4eff-8b4e-0699187649c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.879682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1cd6b-3b21-4771-98c1-5d86d1edcf8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.880298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d15cd-729d-4eff-8b4e-0699187649c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.880587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d15cd-729d-4eff-8b4e-0699187649c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.880867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d15cd-729d-4eff-8b4e-0699187649c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.881485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1cd6b-3b21-4771-98c1-5d86d1edcf8c service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.894662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 825/1625] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:40.896147 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1cd6b-3b21-4771-98c1-5d86d1edcf8c service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.936205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:40.973021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1cd6b-3b21-4771-98c1-5d86d1edcf8c service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:40.978179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d15cd-729d-4eff-8b4e-0699187649c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.978701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f050ea-623f-40ce-9366-9546564c9424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:40.979720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f050ea-623f-40ce-9366-9546564c9424 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:40.979972 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d15cd-729d-4eff-8b4e-0699187649c4 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:40.980237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f050ea-623f-40ce-9366-9546564c9424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:40.980618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f050ea-623f-40ce-9366-9546564c9424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:40.993241 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 801/1626] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:40.995288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d15cd-729d-4eff-8b4e-0699187649c4 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:40.995553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f050ea-623f-40ce-9366-9546564c9424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:40.997316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f050ea-623f-40ce-9366-9546564c9424 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.007010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d15cd-729d-4eff-8b4e-0699187649c4 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.012744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbed81-2a1f-454b-91b9-a3345bf1e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.013621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbed81-2a1f-454b-91b9-a3345bf1e337 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.014055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbed81-2a1f-454b-91b9-a3345bf1e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.014494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbed81-2a1f-454b-91b9-a3345bf1e337 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.015336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbed81-2a1f-454b-91b9-a3345bf1e337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.016087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 826/1627] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:41.017192 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f050ea-623f-40ce-9366-9546564c9424 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.017841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbed81-2a1f-454b-91b9-a3345bf1e337 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.028173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f050ea-623f-40ce-9366-9546564c9424 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.034929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb47f4-f227-4cfc-be65-67dbb108d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.036202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb47f4-f227-4cfc-be65-67dbb108d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.036695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb47f4-f227-4cfc-be65-67dbb108d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.037174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb47f4-f227-4cfc-be65-67dbb108d7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.038156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb47f4-f227-4cfc-be65-67dbb108d7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.040278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb47f4-f227-4cfc-be65-67dbb108d7b1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.046792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 802/1628] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:40 2022] POST /identity/v3/users => generated 288 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:41.051408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbed81-2a1f-454b-91b9-a3345bf1e337 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.057877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 827/1629] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:41.058844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb47f4-f227-4cfc-be65-67dbb108d7b1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.064270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbed81-2a1f-454b-91b9-a3345bf1e337 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.070752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c023-1644-4b07-8f4a-e3593033bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.071441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c023-1644-4b07-8f4a-e3593033bb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.071773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c023-1644-4b07-8f4a-e3593033bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.072050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c023-1644-4b07-8f4a-e3593033bb5d admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.073854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c023-1644-4b07-8f4a-e3593033bb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.076537 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c023-1644-4b07-8f4a-e3593033bb5d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.078616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb47f4-f227-4cfc-be65-67dbb108d7b1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.084478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:41.086454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d867b-273c-4da8-8199-9ca1f3699e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.087658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d867b-273c-4da8-8199-9ca1f3699e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.088677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d867b-273c-4da8-8199-9ca1f3699e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.089305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d867b-273c-4da8-8199-9ca1f3699e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.090311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d867b-273c-4da8-8199-9ca1f3699e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.093759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d867b-273c-4da8-8199-9ca1f3699e4e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.105812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 803/1630] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:41 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:41.106861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c023-1644-4b07-8f4a-e3593033bb5d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.112762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 828/1631] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:41.113977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d867b-273c-4da8-8199-9ca1f3699e4e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.129535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c023-1644-4b07-8f4a-e3593033bb5d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.131680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d867b-273c-4da8-8199-9ca1f3699e4e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.136094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ab5f-7c75-46b1-977b-25d7276958b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.137325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ab5f-7c75-46b1-977b-25d7276958b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.137825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ab5f-7c75-46b1-977b-25d7276958b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.138112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71ab5f-7c75-46b1-977b-25d7276958b8 admin admin] PATH_INFO: `/v3/projects/691ff9e915804315b48d8f3a52262a5e/users/4e3684c487c547bc8194302d4f249b4f/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.139357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a67738-db88-4661-b1c4-2fa77af288a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.140529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71ab5f-7c75-46b1-977b-25d7276958b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691ff9e915804315b48d8f3a52262a5e, user_id=4e3684c487c547bc8194302d4f249b4f, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.140655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a67738-db88-4661-b1c4-2fa77af288a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.141173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a67738-db88-4661-b1c4-2fa77af288a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.141667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a67738-db88-4661-b1c4-2fa77af288a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.143324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a67738-db88-4661-b1c4-2fa77af288a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.145887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a67738-db88-4661-b1c4-2fa77af288a4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.147261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71ab5f-7c75-46b1-977b-25d7276958b8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.162408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 829/1632] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:41.163636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a67738-db88-4661-b1c4-2fa77af288a4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.178697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 804/1633] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:41 2022] PUT /identity/v3/projects/691ff9e915804315b48d8f3a52262a5e/users/4e3684c487c547bc8194302d4f249b4f/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:41.180138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a67738-db88-4661-b1c4-2fa77af288a4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.180996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ab5f-7c75-46b1-977b-25d7276958b8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.351962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71ab5f-7c75-46b1-977b-25d7276958b8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.357367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8f2b8-cc8b-4cce-8bd5-21212a3613ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.358372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b43257-1fdb-4f1b-89e3-87310cdc35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.359201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8f2b8-cc8b-4cce-8bd5-21212a3613ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.359865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b43257-1fdb-4f1b-89e3-87310cdc35af admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.360214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8f2b8-cc8b-4cce-8bd5-21212a3613ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.360331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b43257-1fdb-4f1b-89e3-87310cdc35af admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.360676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b43257-1fdb-4f1b-89e3-87310cdc35af admin admin] PATH_INFO: `/v3/projects/086db2afe9084b0f97723e4c157d5682/users/045d826c26f74c4589643d99050edb04/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.361588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8f2b8-cc8b-4cce-8bd5-21212a3613ae admin admin] PATH_INFO: `/v3/projects/2dfeec35b8bd40dbb6e9e0fd14311148/users/5fc5a62f480442a8a99fa792b6270581/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.382420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b43257-1fdb-4f1b-89e3-87310cdc35af admin admin] RBAC: Authorizing `identity:create_grant(project_id=086db2afe9084b0f97723e4c157d5682, user_id=045d826c26f74c4589643d99050edb04, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.387427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b43257-1fdb-4f1b-89e3-87310cdc35af admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.400016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8f2b8-cc8b-4cce-8bd5-21212a3613ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfeec35b8bd40dbb6e9e0fd14311148, user_id=5fc5a62f480442a8a99fa792b6270581, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.405191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8f2b8-cc8b-4cce-8bd5-21212a3613ae admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.428152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 805/1634] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:41 2022] PUT /identity/v3/projects/086db2afe9084b0f97723e4c157d5682/users/045d826c26f74c4589643d99050edb04/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:41.436245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f63bb-f761-4aa8-be84-a5a1aa6b4398 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.437580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f63bb-f761-4aa8-be84-a5a1aa6b4398 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.438394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f63bb-f761-4aa8-be84-a5a1aa6b4398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.441819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 830/1635] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:41 2022] PUT /identity/v3/projects/2dfeec35b8bd40dbb6e9e0fd14311148/users/5fc5a62f480442a8a99fa792b6270581/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:41.444135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8f2b8-cc8b-4cce-8bd5-21212a3613ae admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.490455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-454f63bb-f761-4aa8-be84-a5a1aa6b4398 None None] MFA Rules not processed for user `4e3684c487c547bc8194302d4f249b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:41.495178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-454f63bb-f761-4aa8-be84-a5a1aa6b4398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:41.541949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8f2b8-cc8b-4cce-8bd5-21212a3613ae admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.551489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489e28-e1c5-476e-b32b-c90f9acd477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.552660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489e28-e1c5-476e-b32b-c90f9acd477a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.553450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489e28-e1c5-476e-b32b-c90f9acd477a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.554016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93489e28-e1c5-476e-b32b-c90f9acd477a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.555583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93489e28-e1c5-476e-b32b-c90f9acd477a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.558162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93489e28-e1c5-476e-b32b-c90f9acd477a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.571674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 831/1636] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:41.573180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489e28-e1c5-476e-b32b-c90f9acd477a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.589420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93489e28-e1c5-476e-b32b-c90f9acd477a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.597255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba439a-3d27-45cc-9f87-5088125d24a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.598538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba439a-3d27-45cc-9f87-5088125d24a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.599078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba439a-3d27-45cc-9f87-5088125d24a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.599795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba439a-3d27-45cc-9f87-5088125d24a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.601118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba439a-3d27-45cc-9f87-5088125d24a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.603471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba439a-3d27-45cc-9f87-5088125d24a6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.619611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 832/1637] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:41.620831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba439a-3d27-45cc-9f87-5088125d24a6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.630445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:41.636246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba439a-3d27-45cc-9f87-5088125d24a6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.645840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3a68f-f674-48d5-8310-6082eaedae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.647692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3a68f-f674-48d5-8310-6082eaedae89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.648131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3a68f-f674-48d5-8310-6082eaedae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.648478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3a68f-f674-48d5-8310-6082eaedae89 admin admin] PATH_INFO: `/v3/projects/086db2afe9084b0f97723e4c157d5682/users/045d826c26f74c4589643d99050edb04/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.651863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3a68f-f674-48d5-8310-6082eaedae89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086db2afe9084b0f97723e4c157d5682, user_id=045d826c26f74c4589643d99050edb04, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.654920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3a68f-f674-48d5-8310-6082eaedae89 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.675398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 833/1638] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:41 2022] PUT /identity/v3/projects/086db2afe9084b0f97723e4c157d5682/users/045d826c26f74c4589643d99050edb04/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:41.676830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3a68f-f674-48d5-8310-6082eaedae89 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.692423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 806/1639] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:41.694246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d0cb-1e9c-4efb-867b-617c70eeae47 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.694246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d0cb-1e9c-4efb-867b-617c70eeae47 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.694519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229d0cb-1e9c-4efb-867b-617c70eeae47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.726896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2229d0cb-1e9c-4efb-867b-617c70eeae47 None None] MFA Rules not processed for user `045d826c26f74c4589643d99050edb04`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:41.728485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2229d0cb-1e9c-4efb-867b-617c70eeae47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:41.778683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:41.862755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 807/1640] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:41.862755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d0cb-1e9c-4efb-867b-617c70eeae47 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:41.863201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3a68f-f674-48d5-8310-6082eaedae89 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:41.876095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a752a-224f-4dca-bab6-5b221146baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:41.878504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a752a-224f-4dca-bab6-5b221146baf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.882028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a752a-224f-4dca-bab6-5b221146baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.882334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a752a-224f-4dca-bab6-5b221146baf9 admin admin] PATH_INFO: `/v3/projects/2dfeec35b8bd40dbb6e9e0fd14311148/users/5fc5a62f480442a8a99fa792b6270581/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.886235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a752a-224f-4dca-bab6-5b221146baf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfeec35b8bd40dbb6e9e0fd14311148, user_id=5fc5a62f480442a8a99fa792b6270581, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:41.894945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a752a-224f-4dca-bab6-5b221146baf9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:41.933213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 834/1641] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:41 2022] PUT /identity/v3/projects/2dfeec35b8bd40dbb6e9e0fd14311148/users/5fc5a62f480442a8a99fa792b6270581/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:41.935530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532eb90-2eeb-45ea-b96d-e491f1e875a2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:41.936026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532eb90-2eeb-45ea-b96d-e491f1e875a2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:41.936402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532eb90-2eeb-45ea-b96d-e491f1e875a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:41.990466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229d0cb-1e9c-4efb-867b-617c70eeae47 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:42.028734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6532eb90-2eeb-45ea-b96d-e491f1e875a2 None None] MFA Rules not processed for user `5fc5a62f480442a8a99fa792b6270581`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:42.030408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6532eb90-2eeb-45ea-b96d-e491f1e875a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:42.122277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 835/1642] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:17:42.123429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532eb90-2eeb-45ea-b96d-e491f1e875a2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:42.126497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a88af5-2441-4c63-ac40-649b1d257de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:42.127170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88af5-2441-4c63-ac40-649b1d257de8 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.127456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88af5-2441-4c63-ac40-649b1d257de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.127728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88af5-2441-4c63-ac40-649b1d257de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.137376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532eb90-2eeb-45ea-b96d-e491f1e875a2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:42.144173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a276e93-a29a-4b9a-8652-24a3dd134963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:42.147848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276e93-a29a-4b9a-8652-24a3dd134963 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.147848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276e93-a29a-4b9a-8652-24a3dd134963 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.147848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a276e93-a29a-4b9a-8652-24a3dd134963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.267321 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276e93-a29a-4b9a-8652-24a3dd134963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:42.273263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a276e93-a29a-4b9a-8652-24a3dd134963 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:42.284218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a88af5-2441-4c63-ac40-649b1d257de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:42.287888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a88af5-2441-4c63-ac40-649b1d257de8 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:42.303202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 836/1643] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:42.312249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 808/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:42.340071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436120a-39b1-4df4-bc23-8214e051a49c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.341023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436120a-39b1-4df4-bc23-8214e051a49c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.341861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436120a-39b1-4df4-bc23-8214e051a49c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.346163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 837/1645] 10.222.0.17 () {54 vars in 961 bytes} [Thu Jul 14 11:17:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:17:42.359930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ba98-2f2b-4088-aa6b-49e76c61791f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.360257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ba98-2f2b-4088-aa6b-49e76c61791f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.360626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2ba98-2f2b-4088-aa6b-49e76c61791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.364666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436120a-39b1-4df4-bc23-8214e051a49c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:42.377779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:42.392314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436120a-39b1-4df4-bc23-8214e051a49c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:42.397053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a5c2ba98-2f2b-4088-aa6b-49e76c61791f None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:42.398552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a5c2ba98-2f2b-4088-aa6b-49e76c61791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:42.410327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e99cd4-10c4-48a2-ba48-61703194a6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:42.411325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99cd4-10c4-48a2-ba48-61703194a6dc service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.411883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99cd4-10c4-48a2-ba48-61703194a6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.413373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e99cd4-10c4-48a2-ba48-61703194a6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.437835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e99cd4-10c4-48a2-ba48-61703194a6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:42.439725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e99cd4-10c4-48a2-ba48-61703194a6dc service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:42.444886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:42.466060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 838/1646] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:42.563692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 809/1647] 10.222.0.17 () {58 vars in 1058 bytes} [Thu Jul 14 11:17:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:42.577258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4896c-d8a0-4eef-8a43-e5a43e2c5b43 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.577879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4896c-d8a0-4eef-8a43-e5a43e2c5b43 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.577879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4896c-d8a0-4eef-8a43-e5a43e2c5b43 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.579923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 839/1648] 10.222.0.17 () {54 vars in 912 bytes} [Thu Jul 14 11:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:17:42.589857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe9178-ac95-4d3b-a853-3cc67fdbaaf1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.590174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe9178-ac95-4d3b-a853-3cc67fdbaaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.590430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe9178-ac95-4d3b-a853-3cc67fdbaaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.616528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2cfe9178-ac95-4d3b-a853-3cc67fdbaaf1 None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:42.617952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2cfe9178-ac95-4d3b-a853-3cc67fdbaaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:42.629648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 810/1649] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:17:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:17:42.710939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4896c-d8a0-4eef-8a43-e5a43e2c5b43 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:42.725616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4896c-d8a0-4eef-8a43-e5a43e2c5b43 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:42.731620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1d7a8-6eef-462a-b083-4db91a305e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:42.732679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1d7a8-6eef-462a-b083-4db91a305e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.732971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1d7a8-6eef-462a-b083-4db91a305e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.733248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1d7a8-6eef-462a-b083-4db91a305e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.750024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe9178-ac95-4d3b-a853-3cc67fdbaaf1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:42.765010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe9178-ac95-4d3b-a853-3cc67fdbaaf1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:42.769470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d26d96-87d6-4439-bd37-224237a94cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:42.770192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26d96-87d6-4439-bd37-224237a94cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.770478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26d96-87d6-4439-bd37-224237a94cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.770810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d26d96-87d6-4439-bd37-224237a94cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:42.784696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d26d96-87d6-4439-bd37-224237a94cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:42.786395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d26d96-87d6-4439-bd37-224237a94cd0 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:42.806669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 811/1650] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:17:42.834527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1d7a8-6eef-462a-b083-4db91a305e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:42.836815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1d7a8-6eef-462a-b083-4db91a305e0e service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:42.860618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 840/1651] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:42.912783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d26d96-87d6-4439-bd37-224237a94cd0 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:42.926213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d26d96-87d6-4439-bd37-224237a94cd0 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:42.935643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39498073-e4db-45db-8515-d6270b4b5d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:42.937480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498073-e4db-45db-8515-d6270b4b5d06 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:42.937480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498073-e4db-45db-8515-d6270b4b5d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:42.937480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39498073-e4db-45db-8515-d6270b4b5d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:43.082258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39498073-e4db-45db-8515-d6270b4b5d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:43.083912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39498073-e4db-45db-8515-d6270b4b5d06 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:43.102103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 812/1652] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:45.691187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1d7a8-6eef-462a-b083-4db91a305e0e service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:45.936594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1d7a8-6eef-462a-b083-4db91a305e0e service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:45.969106 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:45.970036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:45.970323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:45.970608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] PATH_INFO: `/v3/users/7662e6490c3442e4800a0c6b96de3081` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:45.993148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7662e6490c3442e4800a0c6b96de3081)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:45.995462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:46.137752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39498073-e4db-45db-8515-d6270b4b5d06 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:46.155010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39498073-e4db-45db-8515-d6270b4b5d06 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:46.172637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:46.173586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:46.173879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:46.174157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] PATH_INFO: `/v3/users/278de58f2ec74ec1a632f875ee886a4d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:46.178453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=278de58f2ec74ec1a632f875ee886a4d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:46.183481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7662e6490c3442e4800a0c6b96de3081'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.184089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: WARNING py.warnings [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:17:46.184089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: warnings.warn(msg) Jul 14 11:17:46.184089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: Jul 14 11:17:46.184771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7662e6490c3442e4800a0c6b96de3081'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.192625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:46.233006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7662e6490c3442e4800a0c6b96de3081'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.242175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7662e6490c3442e4800a0c6b96de3081'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.245210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d0ef5e0-4b58-4334-a736-02c26c35172c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7662e6490c3442e4800a0c6b96de3081'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.346881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 841/1653] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:17:45 2022] DELETE /identity/v3/users/7662e6490c3442e4800a0c6b96de3081 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:46.351102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be087dae-df90-4dd5-aca3-9acd2fdd7d68 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:46.351437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be087dae-df90-4dd5-aca3-9acd2fdd7d68 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:46.352365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be087dae-df90-4dd5-aca3-9acd2fdd7d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:46.438053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278de58f2ec74ec1a632f875ee886a4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.441150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278de58f2ec74ec1a632f875ee886a4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.457897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-be087dae-df90-4dd5-aca3-9acd2fdd7d68 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:46.461893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be087dae-df90-4dd5-aca3-9acd2fdd7d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:46.476077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:46.523024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278de58f2ec74ec1a632f875ee886a4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.525127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278de58f2ec74ec1a632f875ee886a4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.545707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-abeea57d-bedc-42cc-9f81-334297369afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278de58f2ec74ec1a632f875ee886a4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:46.595629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 813/1654] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:17:46 2022] DELETE /identity/v3/users/278de58f2ec74ec1a632f875ee886a4d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:46.598492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd08537-4230-4f02-a422-d38b792c3001 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:46.599939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd08537-4230-4f02-a422-d38b792c3001 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:46.600273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd08537-4230-4f02-a422-d38b792c3001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:46.655874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9dd08537-4230-4f02-a422-d38b792c3001 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:46.657687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9dd08537-4230-4f02-a422-d38b792c3001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:46.690973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:46.736598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 842/1655] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:46.857853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be087dae-df90-4dd5-aca3-9acd2fdd7d68 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:46.865555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 814/1656] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:46.874268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be087dae-df90-4dd5-aca3-9acd2fdd7d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:47.067589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be087dae-df90-4dd5-aca3-9acd2fdd7d68 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:47.146769 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd08537-4230-4f02-a422-d38b792c3001 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:47.148929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9dd08537-4230-4f02-a422-d38b792c3001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:47.204023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:47.204724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:47.205013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:47.205295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:47.231097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:47.232861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:47.256691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 843/1657] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:17:47.352592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd08537-4230-4f02-a422-d38b792c3001 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:47.365486 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7291f-d849-418c-8978-9e8eeccda970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:47.366332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7291f-d849-418c-8978-9e8eeccda970 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:47.366747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7291f-d849-418c-8978-9e8eeccda970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:47.367226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7291f-d849-418c-8978-9e8eeccda970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:47.389593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7291f-d849-418c-8978-9e8eeccda970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:47.392874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a7291f-d849-418c-8978-9e8eeccda970 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:47.415347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 815/1658] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:49.383310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:49.385247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:49.418377 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3da7af-edf1-4204-a30c-56cf8f8c87f1 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:49.429482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:49.431063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:49.431063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:49.431447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] PATH_INFO: `/v3/projects/1bb35ae08d74495a90816bd8ce7d74d6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:49.436042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb35ae08d74495a90816bd8ce7d74d6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:49.437364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: WARNING py.warnings [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 11:17:49.437364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: warnings.warn(msg) Jul 14 11:17:49.437364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: Jul 14 11:17:49.441367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:49.611842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb35ae08d74495a90816bd8ce7d74d6', 'request_id': 'req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:49.636495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb35ae08d74495a90816bd8ce7d74d6', 'request_id': 'req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:49.653352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb35ae08d74495a90816bd8ce7d74d6', 'request_id': 'req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:49.658326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:49.686557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] The token cache is being invalidate because project 1bb35ae08d74495a90816bd8ce7d74d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:17:49.687895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:49.689708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:49.698331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 844/1659] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:17:49 2022] DELETE /identity/v3/projects/1bb35ae08d74495a90816bd8ce7d74d6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:49.699299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7291f-d849-418c-8978-9e8eeccda970 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:49.711993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7291f-d849-418c-8978-9e8eeccda970 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:49.858191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:49.859231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:49.859527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:49.859850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] PATH_INFO: `/v3/users/5fc5a62f480442a8a99fa792b6270581` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:49.861131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc5a62f480442a8a99fa792b6270581)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:49.863120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:49.981385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc5a62f480442a8a99fa792b6270581'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:49.985682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc5a62f480442a8a99fa792b6270581'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.021935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:50.029191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc5a62f480442a8a99fa792b6270581'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.030199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc5a62f480442a8a99fa792b6270581'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.044461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-90b812ce-dde7-48df-93d3-8cdc92cd0da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc5a62f480442a8a99fa792b6270581'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.081635 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 816/1660] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:17:49 2022] DELETE /identity/v3/users/5fc5a62f480442a8a99fa792b6270581 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:50.342477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:50.346696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:50.371596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ea9ef-7e87-4e29-bde0-9689f1dd31b1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:50.548146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:50.549884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:50.550381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:50.550866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] PATH_INFO: `/v3/projects/57403cb3141e476e8ba23288e24e5643` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:50.553129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57403cb3141e476e8ba23288e24e5643)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:50.556532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:50.665926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57403cb3141e476e8ba23288e24e5643', 'request_id': 'req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.675797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57403cb3141e476e8ba23288e24e5643', 'request_id': 'req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.704614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57403cb3141e476e8ba23288e24e5643', 'request_id': 'req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.736022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] The token cache is being invalidate because project 57403cb3141e476e8ba23288e24e5643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:17:50.736303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78cc45-fa7a-49e8-8a47-57cda1ef5c2e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:50.736731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78cc45-fa7a-49e8-8a47-57cda1ef5c2e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:50.736914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78cc45-fa7a-49e8-8a47-57cda1ef5c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:50.740063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.741998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd5b3e35-18ff-4422-af2f-3ab45e7c9327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:50.746018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 845/1661] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:17:50 2022] DELETE /identity/v3/projects/57403cb3141e476e8ba23288e24e5643 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:50.754780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89340-912b-4bb5-9816-6520203fca62 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:50.755299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89340-912b-4bb5-9816-6520203fca62 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:50.755780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e89340-912b-4bb5-9816-6520203fca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:50.811036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8b78cc45-fa7a-49e8-8a47-57cda1ef5c2e None None] MFA Rules not processed for user `4399658c6afd4afdb0bbca33db91b80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:50.813789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-16e89340-912b-4bb5-9816-6520203fca62 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:50.814393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b78cc45-fa7a-49e8-8a47-57cda1ef5c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:50.817437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-16e89340-912b-4bb5-9816-6520203fca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:50.953669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 846/1662] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:50.962214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5dd2-783b-4598-8d0f-e5f164ce8559 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:50.962605 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5dd2-783b-4598-8d0f-e5f164ce8559 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:50.962964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c5dd2-783b-4598-8d0f-e5f164ce8559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:51.004729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d09c5dd2-783b-4598-8d0f-e5f164ce8559 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:51.005989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d09c5dd2-783b-4598-8d0f-e5f164ce8559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:51.023226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 847/1663] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:51.024171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c5dd2-783b-4598-8d0f-e5f164ce8559 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:51.052652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 817/1664] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:17:51.054009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78cc45-fa7a-49e8-8a47-57cda1ef5c2e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:51.056817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c5dd2-783b-4598-8d0f-e5f164ce8559 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:51.058947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b78cc45-fa7a-49e8-8a47-57cda1ef5c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:51.077085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:51.077795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:51.078083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:51.078365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:51.083039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:51.083361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:51.085055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:51.120644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 848/1665] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:51.129473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:51.137076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:51.151765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585981a9-500d-4d11-8034-2f11982eb529 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:51.160622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5149c1-a55c-442d-8f40-5f7aa14e9911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:51.161983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5149c1-a55c-442d-8f40-5f7aa14e9911 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:51.162532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5149c1-a55c-442d-8f40-5f7aa14e9911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:51.163028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5149c1-a55c-442d-8f40-5f7aa14e9911 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:51.166887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5149c1-a55c-442d-8f40-5f7aa14e9911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:51.174573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5149c1-a55c-442d-8f40-5f7aa14e9911 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:51.230494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 849/1666] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:51 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:51.231934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5149c1-a55c-442d-8f40-5f7aa14e9911 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:51.253502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78cc45-fa7a-49e8-8a47-57cda1ef5c2e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:51.485351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:51.486037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:51.486318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:51.486661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:51.504679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5149c1-a55c-442d-8f40-5f7aa14e9911 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:51.507098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:51.523223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee1bfd-3a6f-4a54-819c-c1f2421e53ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:51.523795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1bfd-3a6f-4a54-819c-c1f2421e53ac admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:51.524213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1bfd-3a6f-4a54-819c-c1f2421e53ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:51.524409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee1bfd-3a6f-4a54-819c-c1f2421e53ac admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:51.525180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee1bfd-3a6f-4a54-819c-c1f2421e53ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:51.527939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee1bfd-3a6f-4a54-819c-c1f2421e53ac admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:51.606197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 850/1667] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:51 2022] POST /identity/v3/users => generated 303 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:51.613142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee1bfd-3a6f-4a54-819c-c1f2421e53ac admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:51.646361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee1bfd-3a6f-4a54-819c-c1f2421e53ac admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:51.682329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:51.683298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac213bf-bb6d-4906-b8f0-50c890584406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:51.684058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac213bf-bb6d-4906-b8f0-50c890584406 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:51.684211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:51.684287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac213bf-bb6d-4906-b8f0-50c890584406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:51.684641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac213bf-bb6d-4906-b8f0-50c890584406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:51.685267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac213bf-bb6d-4906-b8f0-50c890584406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:51.686913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac213bf-bb6d-4906-b8f0-50c890584406 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:51.711858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 818/1668] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:51.720945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 851/1669] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:51.724525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:51.727011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac213bf-bb6d-4906-b8f0-50c890584406 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:51.728239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:51.770494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac213bf-bb6d-4906-b8f0-50c890584406 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:51.797322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa32fe-477c-4735-af8d-9efd09a63607 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:51.800279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad327d-651b-4762-959d-1433324c43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:51.800989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad327d-651b-4762-959d-1433324c43d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:51.801271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad327d-651b-4762-959d-1433324c43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:51.801552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad327d-651b-4762-959d-1433324c43d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:51.802309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad327d-651b-4762-959d-1433324c43d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:51.803969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad327d-651b-4762-959d-1433324c43d2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:51.820986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:51.821895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:51.822191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:51.823014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] PATH_INFO: `/v3/projects/2dfeec35b8bd40dbb6e9e0fd14311148` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:51.824434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dfeec35b8bd40dbb6e9e0fd14311148)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:51.826691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:51.875027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 852/1670] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:51.888080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad327d-651b-4762-959d-1433324c43d2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:51.929344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad327d-651b-4762-959d-1433324c43d2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:51.947682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:51.952162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:51.952979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:51.956539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] PATH_INFO: `/v3/projects/cd6eaaa0f23b462193898eedb5a183d2/users/fd660adcbc204ceca1d5e039ff1cfab1/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.003532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dfeec35b8bd40dbb6e9e0fd14311148', 'request_id': 'req-85c21939-54e0-45e1-80c5-48c64e355bcf'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.021934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6eaaa0f23b462193898eedb5a183d2, user_id=fd660adcbc204ceca1d5e039ff1cfab1, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:52.027274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dfeec35b8bd40dbb6e9e0fd14311148', 'request_id': 'req-85c21939-54e0-45e1-80c5-48c64e355bcf'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.032505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:52.046458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dfeec35b8bd40dbb6e9e0fd14311148', 'request_id': 'req-85c21939-54e0-45e1-80c5-48c64e355bcf'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.084711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 853/1671] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:51 2022] PUT /identity/v3/projects/cd6eaaa0f23b462193898eedb5a183d2/users/fd660adcbc204ceca1d5e039ff1cfab1/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:52.085961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:52.092627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:52.097380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] The token cache is being invalidate because project 2dfeec35b8bd40dbb6e9e0fd14311148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:17:52.097689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.099477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-85c21939-54e0-45e1-80c5-48c64e355bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.104703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 819/1672] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:17:51 2022] DELETE /identity/v3/projects/2dfeec35b8bd40dbb6e9e0fd14311148 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:52.107949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8320-210b-4e67-8bb0-a6f4f91098f4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.108503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8320-210b-4e67-8bb0-a6f4f91098f4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.108966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8320-210b-4e67-8bb0-a6f4f91098f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.159822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-583d8320-210b-4e67-8bb0-a6f4f91098f4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:52.161363 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-583d8320-210b-4e67-8bb0-a6f4f91098f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:52.270053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c924-51fd-4bb0-9dd5-faf2a353a148 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:52.289924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:52.295520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.297390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.298003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] PATH_INFO: `/v3/users/aff441788c2b48afbf227215789147e5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.300651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff441788c2b48afbf227215789147e5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:52.304033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:52.344586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 820/1673] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:52.346128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470be7e6-88bf-44b3-8a37-00153f9e0c63 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.346527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470be7e6-88bf-44b3-8a37-00153f9e0c63 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.346684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470be7e6-88bf-44b3-8a37-00153f9e0c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.362713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:52.406056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-470be7e6-88bf-44b3-8a37-00153f9e0c63 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:52.407327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-470be7e6-88bf-44b3-8a37-00153f9e0c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:52.414573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff441788c2b48afbf227215789147e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.416893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff441788c2b48afbf227215789147e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.429624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff441788c2b48afbf227215789147e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.442400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff441788c2b48afbf227215789147e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.449915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 821/1674] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:52.449915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470be7e6-88bf-44b3-8a37-00153f9e0c63 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:52.449915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-470be7e6-88bf-44b3-8a37-00153f9e0c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:52.453161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6a91f830-ec5c-4ffb-8e5b-10dc136c2a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff441788c2b48afbf227215789147e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:52.476724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 854/1675] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:17:52 2022] DELETE /identity/v3/users/aff441788c2b48afbf227215789147e5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:52.479276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7290a6e-622d-4295-9735-ec4c31e4a66d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.479798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7290a6e-622d-4295-9735-ec4c31e4a66d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.480358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7290a6e-622d-4295-9735-ec4c31e4a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.511187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a7290a6e-622d-4295-9735-ec4c31e4a66d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:52.513604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a7290a6e-622d-4295-9735-ec4c31e4a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:52.517099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:52.629918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470be7e6-88bf-44b3-8a37-00153f9e0c63 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:52.676143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 855/1676] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:52.678489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c996-5b71-4bed-8082-c376664119c3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.678924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c996-5b71-4bed-8082-c376664119c3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.679282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795c996-5b71-4bed-8082-c376664119c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.725265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f795c996-5b71-4bed-8082-c376664119c3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:52.729561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f795c996-5b71-4bed-8082-c376664119c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:52.752024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 856/1677] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:52.753115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c996-5b71-4bed-8082-c376664119c3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:52.774732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795c996-5b71-4bed-8082-c376664119c3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:52.780868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:52.783179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.784073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.785678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.786911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:52.788562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:52.793646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:52.847750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:52.848513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.849598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.849891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.854477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 857/1678] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:52.855383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:52.859840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:52.860962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:52.896184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:52.902286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:52.903299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc958cd-ce7b-4a32-a579-9b1459491e25 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:52.922722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6b1d8-652e-44eb-9b0d-451616368042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:52.923836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b1d8-652e-44eb-9b0d-451616368042 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.924378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b1d8-652e-44eb-9b0d-451616368042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.925002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6b1d8-652e-44eb-9b0d-451616368042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:52.936867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 822/1679] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:52.937970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:52.956890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6b1d8-652e-44eb-9b0d-451616368042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:52.958631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6b1d8-652e-44eb-9b0d-451616368042 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:52.965005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d910a-0c2c-437c-a104-ff55757f3215 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:52.995125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:52.998104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:52.998641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:52.999153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:53.000754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 858/1680] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:53.003614 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:53.014123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:53.077692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6b1d8-652e-44eb-9b0d-451616368042 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:53.078529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 823/1681] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:52 2022] POST /identity/v3/projects => generated 355 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:53.119995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6b1d8-652e-44eb-9b0d-451616368042 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:53.136377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:53.139050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:53.317527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:53.318445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:53.318740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:53.319162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:53.319882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:53.324479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:53.368347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:53.386771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 859/1682] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:53 2022] POST /identity/v3/users => generated 278 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:53.386771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:53.392442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:53.412706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704cea3-3c5b-4aa5-a236-07dbb84871dd admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:53.427401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24357-1460-4cba-96a0-43d95dc0f193 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:53.436526 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:53.437692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:53.440310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:53.440751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] PATH_INFO: `/v3/users/219f991e9c7241178f1621f0d3932bd6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:53.441352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:53.442328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:53.443081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:53.443374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] PATH_INFO: `/v3/users/f694ba79cb6c4e9b83d4d565b381ab01` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:53.444397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=219f991e9c7241178f1621f0d3932bd6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:53.447240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:53.449261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f694ba79cb6c4e9b83d4d565b381ab01)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:53.455989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:53.591263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219f991e9c7241178f1621f0d3932bd6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.595904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f694ba79cb6c4e9b83d4d565b381ab01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.598452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219f991e9c7241178f1621f0d3932bd6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.599233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f694ba79cb6c4e9b83d4d565b381ab01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.614847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f694ba79cb6c4e9b83d4d565b381ab01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.640720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:53.643693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219f991e9c7241178f1621f0d3932bd6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.644286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219f991e9c7241178f1621f0d3932bd6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.644533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f694ba79cb6c4e9b83d4d565b381ab01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.645789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f7467118-6e1b-4ec4-a51d-7959ea5e71fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f694ba79cb6c4e9b83d4d565b381ab01'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.668440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219f991e9c7241178f1621f0d3932bd6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:53.715480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 824/1684] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:17:53 2022] DELETE /identity/v3/users/219f991e9c7241178f1621f0d3932bd6 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:53.716574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:53.718903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 860/1684] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:17:53 2022] DELETE /identity/v3/users/f694ba79cb6c4e9b83d4d565b381ab01 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:53.719432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:53.721519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b1f-95de-477d-850b-d9cdd80de938 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:53.721904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b1f-95de-477d-850b-d9cdd80de938 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:53.722186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b1f-95de-477d-850b-d9cdd80de938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:53.757567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-39622b1f-95de-477d-850b-d9cdd80de938 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:53.761060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-39622b1f-95de-477d-850b-d9cdd80de938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:53.857816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c9293-62c7-4d24-9fb0-d620196adc9c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:53.925008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 861/1685] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:53.927164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb2b1-f29d-4de4-b782-d84e604879df None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:53.927464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb2b1-f29d-4de4-b782-d84e604879df None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:53.927921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddb2b1-f29d-4de4-b782-d84e604879df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:53.954602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4eddb2b1-f29d-4de4-b782-d84e604879df None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:53.956618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4eddb2b1-f29d-4de4-b782-d84e604879df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:53.967843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772eed9-a438-4327-b1ca-91cbcb71b758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:53.969142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772eed9-a438-4327-b1ca-91cbcb71b758 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:53.969634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772eed9-a438-4327-b1ca-91cbcb71b758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:53.970127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772eed9-a438-4327-b1ca-91cbcb71b758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:53.972034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772eed9-a438-4327-b1ca-91cbcb71b758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:53.975235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772eed9-a438-4327-b1ca-91cbcb71b758 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:53.976122 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 862/1686] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:53.987434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb2b1-f29d-4de4-b782-d84e604879df None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:53.990917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4eddb2b1-f29d-4de4-b782-d84e604879df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:54.008679 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 825/1687] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:54.011674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772eed9-a438-4327-b1ca-91cbcb71b758 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:54.054982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772eed9-a438-4327-b1ca-91cbcb71b758 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:54.082471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:54.083353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:54.083746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:54.084978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:54.085886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:54.091905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:54.128247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 826/1688] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:54.129346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:54.139771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:54.187434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddb2b1-f29d-4de4-b782-d84e604879df None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:54.191837 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c838f18-256c-42dd-bd79-1af4a44735f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:54.192743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c838f18-256c-42dd-bd79-1af4a44735f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:54.193331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c838f18-256c-42dd-bd79-1af4a44735f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:54.193753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c838f18-256c-42dd-bd79-1af4a44735f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:54.242760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c838f18-256c-42dd-bd79-1af4a44735f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:54.244963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c838f18-256c-42dd-bd79-1af4a44735f3 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:54.289773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c4cdc-955f-4bb7-9de5-0f3e62e1f47a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:54.300823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 863/1689] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:54.302680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b6af0-43ef-420e-93c4-3d78a200a50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:54.305047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c838f18-256c-42dd-bd79-1af4a44735f3 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:54.305790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b6af0-43ef-420e-93c4-3d78a200a50c service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:54.306192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b6af0-43ef-420e-93c4-3d78a200a50c service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:54.306911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b6af0-43ef-420e-93c4-3d78a200a50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:54.335798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c838f18-256c-42dd-bd79-1af4a44735f3 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:54.342653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b6af0-43ef-420e-93c4-3d78a200a50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:54.345417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b6af0-43ef-420e-93c4-3d78a200a50c service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:54.351567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb07b49-1a7e-4074-93b3-a09b479ade92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:54.352718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb07b49-1a7e-4074-93b3-a09b479ade92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:54.353155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb07b49-1a7e-4074-93b3-a09b479ade92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:54.353642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb07b49-1a7e-4074-93b3-a09b479ade92 admin admin] PATH_INFO: `/v3/projects/db7583f0014546d68341b60d3055d371/users/c5d22b5076444e77a47e11ba7aad1b54/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:54.361782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:54.373814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 827/1690] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:54.385556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb07b49-1a7e-4074-93b3-a09b479ade92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7583f0014546d68341b60d3055d371, user_id=c5d22b5076444e77a47e11ba7aad1b54, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:54.388184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb07b49-1a7e-4074-93b3-a09b479ade92 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:54.411424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 864/1691] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:54 2022] PUT /identity/v3/projects/db7583f0014546d68341b60d3055d371/users/c5d22b5076444e77a47e11ba7aad1b54/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:54.424468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d44ad-f7d5-4562-ac8e-55e00b52afad None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:54.424900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d44ad-f7d5-4562-ac8e-55e00b52afad None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:54.425330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d44ad-f7d5-4562-ac8e-55e00b52afad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:54.486448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:54.499046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9d4d44ad-f7d5-4562-ac8e-55e00b52afad None None] MFA Rules not processed for user `c5d22b5076444e77a47e11ba7aad1b54`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:54.503223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9d4d44ad-f7d5-4562-ac8e-55e00b52afad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:54.777655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 828/1692] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:54.783712 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb07b49-1a7e-4074-93b3-a09b479ade92 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:54.993620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb07b49-1a7e-4074-93b3-a09b479ade92 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:55.003361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d14d99-bbaf-4de3-83b5-f69b6f00256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:55.012651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d14d99-bbaf-4de3-83b5-f69b6f00256d admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:55.012960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d14d99-bbaf-4de3-83b5-f69b6f00256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:55.013230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d14d99-bbaf-4de3-83b5-f69b6f00256d admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:55.013992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d14d99-bbaf-4de3-83b5-f69b6f00256d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:55.016360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d14d99-bbaf-4de3-83b5-f69b6f00256d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:55.062619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 865/1693] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:54 2022] POST /identity/v3/projects => generated 353 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:55.065140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d44ad-f7d5-4562-ac8e-55e00b52afad None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:55.093431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d44ad-f7d5-4562-ac8e-55e00b52afad None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:55.265753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485d59d-5b33-46d3-a618-22e1f97c4fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:55.268608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485d59d-5b33-46d3-a618-22e1f97c4fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:55.268899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485d59d-5b33-46d3-a618-22e1f97c4fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:55.269198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485d59d-5b33-46d3-a618-22e1f97c4fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:55.270048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485d59d-5b33-46d3-a618-22e1f97c4fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:55.276838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485d59d-5b33-46d3-a618-22e1f97c4fb8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:55.329848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 829/1694] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:55 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:55.331161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d14d99-bbaf-4de3-83b5-f69b6f00256d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:55.351526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d14d99-bbaf-4de3-83b5-f69b6f00256d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:55.357632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1805c6-65fc-4a18-bc86-6bf32eae011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:55.358341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1805c6-65fc-4a18-bc86-6bf32eae011e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:55.358629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1805c6-65fc-4a18-bc86-6bf32eae011e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:55.367110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1805c6-65fc-4a18-bc86-6bf32eae011e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:55.371065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1805c6-65fc-4a18-bc86-6bf32eae011e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:55.373407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1805c6-65fc-4a18-bc86-6bf32eae011e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:55.395418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 866/1695] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:55.400200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485d59d-5b33-46d3-a618-22e1f97c4fb8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:55.418190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485d59d-5b33-46d3-a618-22e1f97c4fb8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:55.424761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d1bd-30c1-4407-a3ad-eb2ee9e2f254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:55.425970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d1bd-30c1-4407-a3ad-eb2ee9e2f254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:55.426566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d1bd-30c1-4407-a3ad-eb2ee9e2f254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:55.426940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d1bd-30c1-4407-a3ad-eb2ee9e2f254 admin admin] PATH_INFO: `/v3/projects/51f5ef50d0da43dd8c0fc37fe2814efb/users/e7a650d4492e4c2eb28ba7ecb35ae63a/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:55.467173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84d1bd-30c1-4407-a3ad-eb2ee9e2f254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f5ef50d0da43dd8c0fc37fe2814efb, user_id=e7a650d4492e4c2eb28ba7ecb35ae63a, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:55.475446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84d1bd-30c1-4407-a3ad-eb2ee9e2f254 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:55.502741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 830/1696] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:55 2022] PUT /identity/v3/projects/51f5ef50d0da43dd8c0fc37fe2814efb/users/e7a650d4492e4c2eb28ba7ecb35ae63a/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:55.506639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1805c6-65fc-4a18-bc86-6bf32eae011e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:55.522173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1805c6-65fc-4a18-bc86-6bf32eae011e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:55.698552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:55.714301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:55.714959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:55.715453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:55.716866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:55.720247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:55.755247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 867/1697] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:55.756549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d1bd-30c1-4407-a3ad-eb2ee9e2f254 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:55.772284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d1bd-30c1-4407-a3ad-eb2ee9e2f254 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:55.795771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:55.798420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:55.800249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bf9b9-4da9-4de5-a374-7ba6e1cd35bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:55.801307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bf9b9-4da9-4de5-a374-7ba6e1cd35bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:55.801589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bf9b9-4da9-4de5-a374-7ba6e1cd35bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:55.801878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bf9b9-4da9-4de5-a374-7ba6e1cd35bf admin admin] PATH_INFO: `/v3/projects/51f5ef50d0da43dd8c0fc37fe2814efb/users/e7a650d4492e4c2eb28ba7ecb35ae63a/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:55.811352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bf9b9-4da9-4de5-a374-7ba6e1cd35bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f5ef50d0da43dd8c0fc37fe2814efb, user_id=e7a650d4492e4c2eb28ba7ecb35ae63a, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:55.814245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bf9b9-4da9-4de5-a374-7ba6e1cd35bf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:55.838034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 831/1698] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:55 2022] PUT /identity/v3/projects/51f5ef50d0da43dd8c0fc37fe2814efb/users/e7a650d4492e4c2eb28ba7ecb35ae63a/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:55.854325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408fec-f3e9-4442-9ae4-8d1ab68cda7f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:55.856389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408fec-f3e9-4442-9ae4-8d1ab68cda7f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:55.859092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408fec-f3e9-4442-9ae4-8d1ab68cda7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:55.880673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431098e5-84ec-4263-9ff0-1e4f7002896a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:55.925538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-79408fec-f3e9-4442-9ae4-8d1ab68cda7f None None] MFA Rules not processed for user `e7a650d4492e4c2eb28ba7ecb35ae63a`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:55.927092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-79408fec-f3e9-4442-9ae4-8d1ab68cda7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:55.990949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:56.003984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:56.005629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:56.006152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:56.006534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] PATH_INFO: `/v3/projects/556f85965f6c47619c1a954a2e439d63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:56.008164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] RBAC: Authorizing `identity:delete_project(project_id=556f85965f6c47619c1a954a2e439d63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:56.012007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:56.050390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:56.147882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 832/1699] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:56.165083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79408fec-f3e9-4442-9ae4-8d1ab68cda7f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:56.170779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-79408fec-f3e9-4442-9ae4-8d1ab68cda7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:56.226669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556f85965f6c47619c1a954a2e439d63', 'request_id': 'req-cb925225-5542-4447-a635-dc7b652d636d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.290626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556f85965f6c47619c1a954a2e439d63', 'request_id': 'req-cb925225-5542-4447-a635-dc7b652d636d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.328140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556f85965f6c47619c1a954a2e439d63', 'request_id': 'req-cb925225-5542-4447-a635-dc7b652d636d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.356980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] The token cache is being invalidate because project 556f85965f6c47619c1a954a2e439d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:17:56.357279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.362070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb925225-5542-4447-a635-dc7b652d636d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.367023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 868/1700] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:17:55 2022] DELETE /identity/v3/projects/556f85965f6c47619c1a954a2e439d63 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:56.370518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196cf1-c389-49fd-a6c7-58ff3c02604b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:56.370829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196cf1-c389-49fd-a6c7-58ff3c02604b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:56.371118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196cf1-c389-49fd-a6c7-58ff3c02604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:56.414917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79408fec-f3e9-4442-9ae4-8d1ab68cda7f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:56.420736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2e196cf1-c389-49fd-a6c7-58ff3c02604b None None] MFA Rules not processed for user `f38b26b3a2b6480ead16fb239b327d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:56.421780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2e196cf1-c389-49fd-a6c7-58ff3c02604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:56.538176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:56.538946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:56.539238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:56.539519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:56.546669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:56.624765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 869/1701] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:56.633841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e196cf1-c389-49fd-a6c7-58ff3c02604b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:56.636514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2e196cf1-c389-49fd-a6c7-58ff3c02604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:56.758957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:56.762443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:56.815685 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 833/1702] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:56 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:56.828991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e196cf1-c389-49fd-a6c7-58ff3c02604b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:56.831631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:56.834427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:56.835543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:56.835867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:56.837387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] PATH_INFO: `/v3/users/045d826c26f74c4589643d99050edb04` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:56.838505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:56.839123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=045d826c26f74c4589643d99050edb04)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:56.841393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:56.866260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:56.886568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c0fc4-2392-4035-a1e7-dc81f6989021 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:56.904950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:56.906099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:56.906530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:56.906969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] PATH_INFO: `/v3/projects/905a18cfe99e430d81d9439ccb5194fc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:56.909371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=905a18cfe99e430d81d9439ccb5194fc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:56.910893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:56.935665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045d826c26f74c4589643d99050edb04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.936614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045d826c26f74c4589643d99050edb04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.948269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045d826c26f74c4589643d99050edb04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.960635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045d826c26f74c4589643d99050edb04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:56.961290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045d826c26f74c4589643d99050edb04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.002231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 870/1703] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:17:56 2022] DELETE /identity/v3/users/045d826c26f74c4589643d99050edb04 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:57.003318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:57.006671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:57.057706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:57.070203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905a18cfe99e430d81d9439ccb5194fc', 'request_id': 'req-48c5fd4b-9017-4689-96bc-a9655b775dc1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.078651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905a18cfe99e430d81d9439ccb5194fc', 'request_id': 'req-48c5fd4b-9017-4689-96bc-a9655b775dc1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.114079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905a18cfe99e430d81d9439ccb5194fc', 'request_id': 'req-48c5fd4b-9017-4689-96bc-a9655b775dc1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.123911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a437d8-5aac-4af6-ba5b-e82415b48b28 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:57.142630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] The token cache is being invalidate because project 905a18cfe99e430d81d9439ccb5194fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:17:57.144333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.146993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.153664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 834/1704] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:17:56 2022] DELETE /identity/v3/projects/905a18cfe99e430d81d9439ccb5194fc => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:57.157842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:57.159497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:57.226815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2587ca3-15aa-4ab9-af61-695a367764f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:57.227794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2587ca3-15aa-4ab9-af61-695a367764f7 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:57.228096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2587ca3-15aa-4ab9-af61-695a367764f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:57.228739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2587ca3-15aa-4ab9-af61-695a367764f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:57.230766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f2587ca3-15aa-4ab9-af61-695a367764f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:57.281973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:57.321403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5fd4b-9017-4689-96bc-a9655b775dc1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:57.329743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2587ca3-15aa-4ab9-af61-695a367764f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:57.331953 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2587ca3-15aa-4ab9-af61-695a367764f7 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:57.348475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 871/1705] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:57.350145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6a9b-b86d-4a22-93f2-34d5ea163434 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:57.350548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6a9b-b86d-4a22-93f2-34d5ea163434 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:57.351134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f6a9b-b86d-4a22-93f2-34d5ea163434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:57.354607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:57.356381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:57.356977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:57.357555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] PATH_INFO: `/v3/projects/9a607defd93e446ebef41a9a497145cb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:57.359961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a607defd93e446ebef41a9a497145cb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:57.364231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:57.388090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fa2f6a9b-b86d-4a22-93f2-34d5ea163434 None None] MFA Rules not processed for user `fd660adcbc204ceca1d5e039ff1cfab1`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:57.389634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fa2f6a9b-b86d-4a22-93f2-34d5ea163434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:57.507856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a607defd93e446ebef41a9a497145cb', 'request_id': 'req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.521683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 872/1706] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:57.522668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f6a9b-b86d-4a22-93f2-34d5ea163434 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:57.527012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fa2f6a9b-b86d-4a22-93f2-34d5ea163434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:57.563227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a607defd93e446ebef41a9a497145cb', 'request_id': 'req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.587310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a607defd93e446ebef41a9a497145cb', 'request_id': 'req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.609369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] The token cache is being invalidate because project 9a607defd93e446ebef41a9a497145cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:17:57.609565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.611489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:57.617782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 835/1707] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:17:57 2022] DELETE /identity/v3/projects/9a607defd93e446ebef41a9a497145cb => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:57.619084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:57.623491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:57.650102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f6a9b-b86d-4a22-93f2-34d5ea163434 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:57.725445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309b209-16d8-4558-98ed-21ff44b63ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:57.726224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309b209-16d8-4558-98ed-21ff44b63ebb service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:57.744158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309b209-16d8-4558-98ed-21ff44b63ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:57.746323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309b209-16d8-4558-98ed-21ff44b63ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:57.753737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a309b209-16d8-4558-98ed-21ff44b63ebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:57.802092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f5cd7-9b1a-4ae5-a179-4df289ed83dc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:57.815744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:57.816734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:57.817020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:57.817304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] PATH_INFO: `/v3/users/4e3684c487c547bc8194302d4f249b4f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:57.818740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3684c487c547bc8194302d4f249b4f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:57.821186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:57.824756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:57.845080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:57.938089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309b209-16d8-4558-98ed-21ff44b63ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:57.939661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309b209-16d8-4558-98ed-21ff44b63ebb service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:57.961092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 873/1708] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:57 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:57.965280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c731c-1638-4399-94f9-802104384e2e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:57.965579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c731c-1638-4399-94f9-802104384e2e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:57.965864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c731c-1638-4399-94f9-802104384e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:58.059248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cc8c731c-1638-4399-94f9-802104384e2e None None] MFA Rules not processed for user `c2802dc1edb54153ad2c0e2751563489`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:58.061867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3684c487c547bc8194302d4f249b4f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.062023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cc8c731c-1638-4399-94f9-802104384e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:58.062918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3684c487c547bc8194302d4f249b4f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.120802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3684c487c547bc8194302d4f249b4f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.124189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3684c487c547bc8194302d4f249b4f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.146539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3684c487c547bc8194302d4f249b4f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.209087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 836/1709] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:17:57 2022] DELETE /identity/v3/users/4e3684c487c547bc8194302d4f249b4f => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:58.211280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:58.218478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:58.266622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 874/1710] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:58.268349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da1d1-9517-47af-9f4b-0f54825561d3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:58.268755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da1d1-9517-47af-9f4b-0f54825561d3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:58.269153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da1d1-9517-47af-9f4b-0f54825561d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:58.310759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2f2da1d1-9517-47af-9f4b-0f54825561d3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:58.314721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2f2da1d1-9517-47af-9f4b-0f54825561d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:58.386281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a5b85-960a-4dde-9a5e-183606d3ba65 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:58.397283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5cb9-9442-4041-bb69-5b937da52d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:58.397989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5cb9-9442-4041-bb69-5b937da52d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:58.398274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5cb9-9442-4041-bb69-5b937da52d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:58.399304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5cb9-9442-4041-bb69-5b937da52d56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:58.401175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5cb9-9442-4041-bb69-5b937da52d56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:58.403158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5cb9-9442-4041-bb69-5b937da52d56 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:58.470480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 875/1711] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:58.473696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da1d1-9517-47af-9f4b-0f54825561d3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:58.480200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 837/1712] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:58 2022] POST /identity/v3/projects => generated 403 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:58.481189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96589455-83f3-4d5c-9ed2-194e9668954e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:58.482329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2f2da1d1-9517-47af-9f4b-0f54825561d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:58.485246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96589455-83f3-4d5c-9ed2-194e9668954e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:58.485246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96589455-83f3-4d5c-9ed2-194e9668954e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:58.515448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da1d1-9517-47af-9f4b-0f54825561d3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:58.533381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-96589455-83f3-4d5c-9ed2-194e9668954e None None] MFA Rules not processed for user `c2802dc1edb54153ad2c0e2751563489`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:58.544785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-96589455-83f3-4d5c-9ed2-194e9668954e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:58.674898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:58.680496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:58.681661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:58.683166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] PATH_INFO: `/v3/projects/086db2afe9084b0f97723e4c157d5682` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:58.687260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086db2afe9084b0f97723e4c157d5682)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:58.691294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:58.693659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:58.715475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 838/1713] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:58.716866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b711c2-669b-4777-8f01-d540b5e2c493 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:58.717159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b711c2-669b-4777-8f01-d540b5e2c493 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:58.717441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b711c2-669b-4777-8f01-d540b5e2c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:58.759203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-05b711c2-669b-4777-8f01-d540b5e2c493 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:58.760468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-05b711c2-669b-4777-8f01-d540b5e2c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:58.782571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 839/1714] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:58.783487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b711c2-669b-4777-8f01-d540b5e2c493 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:58.794039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:58.804252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b711c2-669b-4777-8f01-d540b5e2c493 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:58.816986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086db2afe9084b0f97723e4c157d5682', 'request_id': 'req-1c22c0fa-39ba-43da-87ee-8e068ba0e703'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.830547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086db2afe9084b0f97723e4c157d5682', 'request_id': 'req-1c22c0fa-39ba-43da-87ee-8e068ba0e703'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.843625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086db2afe9084b0f97723e4c157d5682', 'request_id': 'req-1c22c0fa-39ba-43da-87ee-8e068ba0e703'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.866565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] The token cache is being invalidate because project 086db2afe9084b0f97723e4c157d5682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:17:58.867536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.869626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:58.874099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 876/1715] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:17:58 2022] DELETE /identity/v3/projects/086db2afe9084b0f97723e4c157d5682 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:58.877030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:58.885607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:58.967925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894da5a-293a-4b87-8d18-6c5293f17ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:58.968663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894da5a-293a-4b87-8d18-6c5293f17ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:58.968945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894da5a-293a-4b87-8d18-6c5293f17ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:58.969219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894da5a-293a-4b87-8d18-6c5293f17ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:58.970036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894da5a-293a-4b87-8d18-6c5293f17ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:58.971876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894da5a-293a-4b87-8d18-6c5293f17ea4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:59.014204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 840/1716] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:58 2022] POST /identity/v3/users => generated 308 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:59.019364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f8df7-db40-4447-9afe-400a84c4ee6b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.019732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f8df7-db40-4447-9afe-400a84c4ee6b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.020012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f8df7-db40-4447-9afe-400a84c4ee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.064886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22c0fa-39ba-43da-87ee-8e068ba0e703 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:59.069944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-826f8df7-db40-4447-9afe-400a84c4ee6b None None] MFA Rules not processed for user `4399658c6afd4afdb0bbca33db91b80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:59.070276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:59.070956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.071238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.071512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.072933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-826f8df7-db40-4447-9afe-400a84c4ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.078937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.205178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 841/1717] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:59.205178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f8df7-db40-4447-9afe-400a84c4ee6b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:59.205178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-826f8df7-db40-4447-9afe-400a84c4ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.227043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f8df7-db40-4447-9afe-400a84c4ee6b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:59.234511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d04d8c-f3f5-49c5-bf14-bd8d58eaa506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:59.235397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04d8c-f3f5-49c5-bf14-bd8d58eaa506 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.235780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04d8c-f3f5-49c5-bf14-bd8d58eaa506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.236156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d04d8c-f3f5-49c5-bf14-bd8d58eaa506 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.237450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04d8c-f3f5-49c5-bf14-bd8d58eaa506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:17:59.237831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04d8c-f3f5-49c5-bf14-bd8d58eaa506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:59.241103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d04d8c-f3f5-49c5-bf14-bd8d58eaa506 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:59.253488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:59.255079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:59.271843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 842/1718] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:17:59.276688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9000810-a165-4396-8406-d8871b9e9f83 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.276988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9000810-a165-4396-8406-d8871b9e9f83 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.278744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9000810-a165-4396-8406-d8871b9e9f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.282223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 877/1719] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:17:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:17:59.283535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:59.285971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.310870 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175a38-dbce-4072-ae8b-993c4f7b3bf8 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:59.316650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:59.317732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.318221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.318704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.319781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:59.321749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:59.341128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 878/1720] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:17:59.346043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:59.349478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.357278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a9000810-a165-4396-8406-d8871b9e9f83 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:59.365047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a9000810-a165-4396-8406-d8871b9e9f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.393895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fefa3-6ed9-4401-ba38-c736591ca673 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:59.394586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 843/1721] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:59.395511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9000810-a165-4396-8406-d8871b9e9f83 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:59.409422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:59.410434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.410837 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.411997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] PATH_INFO: `/v3/projects/691ff9e915804315b48d8f3a52262a5e` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.414356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=691ff9e915804315b48d8f3a52262a5e)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:59.417756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:59.422426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9000810-a165-4396-8406-d8871b9e9f83 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:59.437677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b26d8-8a5a-4245-af9f-76bdc4ee898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:59.438643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b26d8-8a5a-4245-af9f-76bdc4ee898f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.439140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b26d8-8a5a-4245-af9f-76bdc4ee898f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.439434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b26d8-8a5a-4245-af9f-76bdc4ee898f admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.440279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b26d8-8a5a-4245-af9f-76bdc4ee898f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:59.443438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b26d8-8a5a-4245-af9f-76bdc4ee898f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:59.443623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:59.523091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 844/1722] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:17:59 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:17:59.524304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b26d8-8a5a-4245-af9f-76bdc4ee898f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:59.556855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691ff9e915804315b48d8f3a52262a5e', 'request_id': 'req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:59.566919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691ff9e915804315b48d8f3a52262a5e', 'request_id': 'req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:59.579313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691ff9e915804315b48d8f3a52262a5e', 'request_id': 'req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:59.609723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] The token cache is being invalidate because project 691ff9e915804315b48d8f3a52262a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:17:59.611361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:59.613540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-48fbaa28-585b-4e50-aa58-13ad9b8c7bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:17:59.617776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 879/1723] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:17:59 2022] DELETE /identity/v3/projects/691ff9e915804315b48d8f3a52262a5e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:59.623425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfaaed-9bfb-4282-919c-0774c02eb4ae None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.623780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfaaed-9bfb-4282-919c-0774c02eb4ae None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.624063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfaaed-9bfb-4282-919c-0774c02eb4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.659852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f8dfaaed-9bfb-4282-919c-0774c02eb4ae None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:59.661396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f8dfaaed-9bfb-4282-919c-0774c02eb4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.683432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:17:59.693019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b26d8-8a5a-4245-af9f-76bdc4ee898f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:59.710623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:59.712079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.712585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.713071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] PATH_INFO: `/v3/projects/b45d23fcd0b74f409922b2e5fc96eade/users/637add54b1034ad799f946615fc6870f/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.749328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45d23fcd0b74f409922b2e5fc96eade, user_id=637add54b1034ad799f946615fc6870f, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:59.752207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:59.785042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 845/1724] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:17:59 2022] PUT /identity/v3/projects/b45d23fcd0b74f409922b2e5fc96eade/users/637add54b1034ad799f946615fc6870f/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:17:59.786327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:59.790586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.857364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 880/1725] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:59.863623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d636-1622-4928-bb20-1ae96873f60f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.864019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d636-1622-4928-bb20-1ae96873f60f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.864334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10d636-1622-4928-bb20-1ae96873f60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.933392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3d10d636-1622-4928-bb20-1ae96873f60f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:17:59.934794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3d10d636-1622-4928-bb20-1ae96873f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.941939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74da12-bae8-49b8-ab3f-3552b5f1491f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:17:59.956432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dae10-5db4-4750-a7f7-8bc819a9c286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:17:59.957106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dae10-5db4-4750-a7f7-8bc819a9c286 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:17:59.957379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dae10-5db4-4750-a7f7-8bc819a9c286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:17:59.957662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dae10-5db4-4750-a7f7-8bc819a9c286 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:17:59.960880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 881/1726] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:17:59.961677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dae10-5db4-4750-a7f7-8bc819a9c286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:17:59.961847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10d636-1622-4928-bb20-1ae96873f60f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:17:59.967907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3d10d636-1622-4928-bb20-1ae96873f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:17:59.968788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dae10-5db4-4750-a7f7-8bc819a9c286 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:17:59.998589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10d636-1622-4928-bb20-1ae96873f60f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.023685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d345d-8f34-424b-9280-4984110539ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.024450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d345d-8f34-424b-9280-4984110539ac admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.024735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d345d-8f34-424b-9280-4984110539ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.025014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d345d-8f34-424b-9280-4984110539ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.025920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d345d-8f34-424b-9280-4984110539ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.033843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d345d-8f34-424b-9280-4984110539ac admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.050061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 846/1727] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:17:59 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:00.050061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dae10-5db4-4750-a7f7-8bc819a9c286 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.076698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 882/1728] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:00.089830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b99f9-9516-478d-ac94-daaafbee0383 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.090113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b99f9-9516-478d-ac94-daaafbee0383 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.090394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b99f9-9516-478d-ac94-daaafbee0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.091140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dae10-5db4-4750-a7f7-8bc819a9c286 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.103411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.107821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.108172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.108434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.109447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:00.109753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.117596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.141161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-be1b99f9-9516-478d-ac94-daaafbee0383 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:00.142419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be1b99f9-9516-478d-ac94-daaafbee0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:00.171465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 847/1729] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:00.173600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.175921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 883/1730] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:00.176916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b99f9-9516-478d-ac94-daaafbee0383 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.205391 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9ca7f-6e33-4e7b-8f73-6bac4a85dfd2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.210618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b99f9-9516-478d-ac94-daaafbee0383 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.222244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f8493-e766-4739-aafe-1f88723dade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.224717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c234b6-b15d-4e57-bff8-84b11f1db189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.225642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c234b6-b15d-4e57-bff8-84b11f1db189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.225924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c234b6-b15d-4e57-bff8-84b11f1db189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.226200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c234b6-b15d-4e57-bff8-84b11f1db189 admin admin] PATH_INFO: `/v3/projects/b45d23fcd0b74f409922b2e5fc96eade/users/637add54b1034ad799f946615fc6870f/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.227673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8493-e766-4739-aafe-1f88723dade4 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.228061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8493-e766-4739-aafe-1f88723dade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.228400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8493-e766-4739-aafe-1f88723dade4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.231665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c234b6-b15d-4e57-bff8-84b11f1db189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45d23fcd0b74f409922b2e5fc96eade, user_id=637add54b1034ad799f946615fc6870f, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.234937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c234b6-b15d-4e57-bff8-84b11f1db189 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.238499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f8493-e766-4739-aafe-1f88723dade4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.240200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f8493-e766-4739-aafe-1f88723dade4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.259440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 884/1731] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:00 2022] PUT /identity/v3/projects/b45d23fcd0b74f409922b2e5fc96eade/users/637add54b1034ad799f946615fc6870f/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:00.261233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c234b6-b15d-4e57-bff8-84b11f1db189 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.321568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 848/1732] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:00.321568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f8493-e766-4739-aafe-1f88723dade4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.361426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f8493-e766-4739-aafe-1f88723dade4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.454030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c234b6-b15d-4e57-bff8-84b11f1db189 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.464685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91421579-8aca-4b0b-bfcd-ee651f618f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.466284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91421579-8aca-4b0b-bfcd-ee651f618f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.466998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91421579-8aca-4b0b-bfcd-ee651f618f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.467527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91421579-8aca-4b0b-bfcd-ee651f618f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.469418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91421579-8aca-4b0b-bfcd-ee651f618f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.472012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91421579-8aca-4b0b-bfcd-ee651f618f37 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.478389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:00.525078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 885/1733] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:00 2022] POST /identity/v3/projects => generated 367 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:00.530812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91421579-8aca-4b0b-bfcd-ee651f618f37 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.642043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474cb9a3-07a5-4f08-9aea-68e382efaa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.646719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cb9a3-07a5-4f08-9aea-68e382efaa48 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.648537 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cb9a3-07a5-4f08-9aea-68e382efaa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.655992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cb9a3-07a5-4f08-9aea-68e382efaa48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.661888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cb9a3-07a5-4f08-9aea-68e382efaa48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:00.664402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cb9a3-07a5-4f08-9aea-68e382efaa48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.670286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474cb9a3-07a5-4f08-9aea-68e382efaa48 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.722577 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 849/1734] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:00.730419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91421579-8aca-4b0b-bfcd-ee651f618f37 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.732802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc72f-5aa9-423e-a584-d2340ee90df8 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.733150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc72f-5aa9-423e-a584-d2340ee90df8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.733441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bc72f-5aa9-423e-a584-d2340ee90df8 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.742085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 850/1735] 10.222.0.17 () {54 vars in 912 bytes} [Thu Jul 14 11:18:00 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:18:00.742514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc72f-5aa9-423e-a584-d2340ee90df8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.754606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3ed12-34d8-4313-b3c4-a01d30b19155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.755532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ed12-34d8-4313-b3c4-a01d30b19155 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.755888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ed12-34d8-4313-b3c4-a01d30b19155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.756446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3ed12-34d8-4313-b3c4-a01d30b19155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.760088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3ed12-34d8-4313-b3c4-a01d30b19155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.763915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3ed12-34d8-4313-b3c4-a01d30b19155 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.777327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bc72f-5aa9-423e-a584-d2340ee90df8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.799116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 886/1736] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:00.799116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3ed12-34d8-4313-b3c4-a01d30b19155 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.802356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05257f-2326-4d15-ad94-71c42ef3d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.803231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05257f-2326-4d15-ad94-71c42ef3d28f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.803626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05257f-2326-4d15-ad94-71c42ef3d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.803950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05257f-2326-4d15-ad94-71c42ef3d28f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.804883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05257f-2326-4d15-ad94-71c42ef3d28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.808142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05257f-2326-4d15-ad94-71c42ef3d28f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.842819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3ed12-34d8-4313-b3c4-a01d30b19155 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:00.852589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fca0-03a3-4ab3-aa3c-362a40b5584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:00.854287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 851/1737] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:00 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:00.858507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac54c-f959-46b6-88ed-1e9218748f91 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.859094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac54c-f959-46b6-88ed-1e9218748f91 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.859403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ac54c-f959-46b6-88ed-1e9218748f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.859537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fca0-03a3-4ab3-aa3c-362a40b5584a admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:00.859833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fca0-03a3-4ab3-aa3c-362a40b5584a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:00.860234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627fca0-03a3-4ab3-aa3c-362a40b5584a admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:00.861047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627fca0-03a3-4ab3-aa3c-362a40b5584a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:00.863965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627fca0-03a3-4ab3-aa3c-362a40b5584a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:00.938112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 887/1738] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:00 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:00.939054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fca0-03a3-4ab3-aa3c-362a40b5584a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:00.961915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:00.977559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-779ac54c-f959-46b6-88ed-1e9218748f91 None None] MFA Rules not processed for user `a367d904a4a44e91862da4aea28a123b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:00.985257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-779ac54c-f959-46b6-88ed-1e9218748f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:01.067696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 852/1739] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:18:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:01.069630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac54c-f959-46b6-88ed-1e9218748f91 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:01.184812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ac54c-f959-46b6-88ed-1e9218748f91 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:01.190783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cfd1f-df20-489a-abed-e2baa1eea04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:01.191494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cfd1f-df20-489a-abed-e2baa1eea04d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.191778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cfd1f-df20-489a-abed-e2baa1eea04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.192057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cfd1f-df20-489a-abed-e2baa1eea04d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:01.193763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cfd1f-df20-489a-abed-e2baa1eea04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:01.196226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cfd1f-df20-489a-abed-e2baa1eea04d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:01.202378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627fca0-03a3-4ab3-aa3c-362a40b5584a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:01.220747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 853/1740] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:01.220747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cfd1f-df20-489a-abed-e2baa1eea04d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:01.251981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:01.258457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.261105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.261345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cfd1f-df20-489a-abed-e2baa1eea04d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:01.261977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] PATH_INFO: `/v3/projects/8ef45fd6a76342f5b4abe3f10923b71a/users/78d91cf8dd27402ab10a3fcdd6274263/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:01.281719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc535e-1d73-4028-9955-a885ea5b3c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:01.282508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc535e-1d73-4028-9955-a885ea5b3c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.282851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc535e-1d73-4028-9955-a885ea5b3c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.283140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc535e-1d73-4028-9955-a885ea5b3c7f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:01.284034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc535e-1d73-4028-9955-a885ea5b3c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:01.295606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc535e-1d73-4028-9955-a885ea5b3c7f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:01.349173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef45fd6a76342f5b4abe3f10923b71a, user_id=78d91cf8dd27402ab10a3fcdd6274263, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:01.356524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 854/1741] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:01 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:01.357479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc535e-1d73-4028-9955-a885ea5b3c7f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:01.359578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:01.406294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc535e-1d73-4028-9955-a885ea5b3c7f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:01.418885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 888/1742] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:00 2022] PUT /identity/v3/projects/8ef45fd6a76342f5b4abe3f10923b71a/users/78d91cf8dd27402ab10a3fcdd6274263/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:01.420744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:01.431360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:01.604263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6dff-8402-443c-9537-cc40f76f92bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:01.604694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6dff-8402-443c-9537-cc40f76f92bb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.608169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:01.614586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6dff-8402-443c-9537-cc40f76f92bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.614982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d6dff-8402-443c-9537-cc40f76f92bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:01.617213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d6dff-8402-443c-9537-cc40f76f92bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:01.622806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d6dff-8402-443c-9537-cc40f76f92bb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:01.645897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810c9c-de43-4812-8127-fe4de4dfabdf admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:01.659892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d7c6f-7975-49c1-969e-1c2ba2c999be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:01.661855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d7c6f-7975-49c1-969e-1c2ba2c999be service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.662593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d7c6f-7975-49c1-969e-1c2ba2c999be service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.663391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d7c6f-7975-49c1-969e-1c2ba2c999be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:01.668414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 855/1743] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:01.669415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6dff-8402-443c-9537-cc40f76f92bb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:01.687142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d7c6f-7975-49c1-969e-1c2ba2c999be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:01.693145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d7c6f-7975-49c1-969e-1c2ba2c999be service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:01.710427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d6dff-8402-443c-9537-cc40f76f92bb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:01.727898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccefe3-1728-4dc9-bbaa-6f5a1d046f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:01.729682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccefe3-1728-4dc9-bbaa-6f5a1d046f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.730339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccefe3-1728-4dc9-bbaa-6f5a1d046f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.730909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccefe3-1728-4dc9-bbaa-6f5a1d046f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:01.733274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccefe3-1728-4dc9-bbaa-6f5a1d046f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:01.737341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccefe3-1728-4dc9-bbaa-6f5a1d046f03 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:01.742293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 889/1744] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:01.744301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241654-f6bc-43c9-a3ec-ee65833e0c82 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.747338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241654-f6bc-43c9-a3ec-ee65833e0c82 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.747787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21241654-f6bc-43c9-a3ec-ee65833e0c82 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:01.752991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 890/1745] 10.222.0.17 () {54 vars in 912 bytes} [Thu Jul 14 11:18:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:18:01.755583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cee8a-f3c4-4c4a-9a74-8846cd7b2417 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.756739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cee8a-f3c4-4c4a-9a74-8846cd7b2417 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.759947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cee8a-f3c4-4c4a-9a74-8846cd7b2417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:01.828624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ed8cee8a-f3c4-4c4a-9a74-8846cd7b2417 None None] MFA Rules not processed for user `78d91cf8dd27402ab10a3fcdd6274263`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:01.830386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ed8cee8a-f3c4-4c4a-9a74-8846cd7b2417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:01.844973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 856/1746] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:01.857109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccefe3-1728-4dc9-bbaa-6f5a1d046f03 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:01.900043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccefe3-1728-4dc9-bbaa-6f5a1d046f03 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:01.946909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6b151-ccc6-4749-8605-8bb4584031d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:01.952695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b151-ccc6-4749-8605-8bb4584031d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:01.954082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b151-ccc6-4749-8605-8bb4584031d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:01.955060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b151-ccc6-4749-8605-8bb4584031d4 admin admin] PATH_INFO: `/v3/projects/a2b6cac9c8134204a7b15b3930d55393/users/50677310f4074ffeb18626449c52a9cb/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:02.035536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6b151-ccc6-4749-8605-8bb4584031d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b6cac9c8134204a7b15b3930d55393, user_id=50677310f4074ffeb18626449c52a9cb, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:02.051374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6b151-ccc6-4749-8605-8bb4584031d4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:02.071112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:02.131128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 857/1747] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:01 2022] PUT /identity/v3/projects/a2b6cac9c8134204a7b15b3930d55393/users/50677310f4074ffeb18626449c52a9cb/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:02.131128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f33ff-d7da-4700-b2b0-1fb39ac3720c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:02.131576 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 891/1748] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:02.132052 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f33ff-d7da-4700-b2b0-1fb39ac3720c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:02.132151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cee8a-f3c4-4c4a-9a74-8846cd7b2417 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:02.132240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f33ff-d7da-4700-b2b0-1fb39ac3720c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:02.155959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cee8a-f3c4-4c4a-9a74-8846cd7b2417 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:02.260747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-115f33ff-d7da-4700-b2b0-1fb39ac3720c None None] MFA Rules not processed for user `a367d904a4a44e91862da4aea28a123b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:02.265541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-115f33ff-d7da-4700-b2b0-1fb39ac3720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:02.332636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce3da6-711c-4074-a27b-1908d15d5a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:02.338697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce3da6-711c-4074-a27b-1908d15d5a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:02.339088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce3da6-711c-4074-a27b-1908d15d5a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:02.339368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce3da6-711c-4074-a27b-1908d15d5a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:02.340301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce3da6-711c-4074-a27b-1908d15d5a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:02.342381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce3da6-711c-4074-a27b-1908d15d5a95 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:02.374508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 892/1749] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:02.376029 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948566c-79c1-479c-a298-c58ef87d3ca8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:02.378775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948566c-79c1-479c-a298-c58ef87d3ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:02.379372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948566c-79c1-479c-a298-c58ef87d3ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:02.410167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 858/1750] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:02.415201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788276c1-f2fa-451c-ab4d-a459df91dee8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:02.423015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788276c1-f2fa-451c-ab4d-a459df91dee8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:02.423703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788276c1-f2fa-451c-ab4d-a459df91dee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:02.442669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8948566c-79c1-479c-a298-c58ef87d3ca8 None None] MFA Rules not processed for user `50677310f4074ffeb18626449c52a9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:02.443970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8948566c-79c1-479c-a298-c58ef87d3ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:02.482695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-788276c1-f2fa-451c-ab4d-a459df91dee8 None None] MFA Rules not processed for user `f38b26b3a2b6480ead16fb239b327d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:02.483982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-788276c1-f2fa-451c-ab4d-a459df91dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:02.662213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 893/1751] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:02.663304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948566c-79c1-479c-a298-c58ef87d3ca8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:02.676736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:02.692618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948566c-79c1-479c-a298-c58ef87d3ca8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:02.715383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981cdec-958c-46f2-877b-c27132a80e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:02.716358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981cdec-958c-46f2-877b-c27132a80e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:02.716632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981cdec-958c-46f2-877b-c27132a80e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:02.716934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981cdec-958c-46f2-877b-c27132a80e54 admin admin] PATH_INFO: `/v3/projects/348d160bc5db4313967c50624c4bfce1/users/cbebf8301d7f441da881dbc92d3f911c/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:02.781022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981cdec-958c-46f2-877b-c27132a80e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348d160bc5db4313967c50624c4bfce1, user_id=cbebf8301d7f441da881dbc92d3f911c, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:02.783273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 859/1752] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:02.784533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788276c1-f2fa-451c-ab4d-a459df91dee8 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:02.788908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981cdec-958c-46f2-877b-c27132a80e54 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:02.792044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-788276c1-f2fa-451c-ab4d-a459df91dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:02.809852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 894/1753] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:02 2022] PUT /identity/v3/projects/348d160bc5db4313967c50624c4bfce1/users/cbebf8301d7f441da881dbc92d3f911c/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:02.810624 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788276c1-f2fa-451c-ab4d-a459df91dee8 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:02.811142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981cdec-958c-46f2-877b-c27132a80e54 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:02.948267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981cdec-958c-46f2-877b-c27132a80e54 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:02.955130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb483db-19d0-490a-9cef-cdb62a3bee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:02.956209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb483db-19d0-490a-9cef-cdb62a3bee23 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:02.956605 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb483db-19d0-490a-9cef-cdb62a3bee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:02.956976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb483db-19d0-490a-9cef-cdb62a3bee23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:02.958680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d02ae-3ee1-4675-94ea-f1535ffd2bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:02.958975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb483db-19d0-490a-9cef-cdb62a3bee23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:02.959994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d02ae-3ee1-4675-94ea-f1535ffd2bad service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:02.960466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d02ae-3ee1-4675-94ea-f1535ffd2bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:02.960888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d02ae-3ee1-4675-94ea-f1535ffd2bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:02.961464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb483db-19d0-490a-9cef-cdb62a3bee23 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:02.973682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d02ae-3ee1-4675-94ea-f1535ffd2bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:02.975671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d02ae-3ee1-4675-94ea-f1535ffd2bad service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:02.997047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 860/1754] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:03.006810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303208c-a980-4fe0-9143-5bb02fc68820 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:03.006810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303208c-a980-4fe0-9143-5bb02fc68820 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:03.007129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303208c-a980-4fe0-9143-5bb02fc68820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:03.015879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 895/1755] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:02 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:03.018160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b52c7-deac-45c5-aef1-a2ec9c9ebb46 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:03.018993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b52c7-deac-45c5-aef1-a2ec9c9ebb46 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:03.019559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b52c7-deac-45c5-aef1-a2ec9c9ebb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:03.052240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4303208c-a980-4fe0-9143-5bb02fc68820 None None] MFA Rules not processed for user `637add54b1034ad799f946615fc6870f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:03.053497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4303208c-a980-4fe0-9143-5bb02fc68820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:03.063393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fb5b52c7-deac-45c5-aef1-a2ec9c9ebb46 None None] MFA Rules not processed for user `cbebf8301d7f441da881dbc92d3f911c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:03.063393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fb5b52c7-deac-45c5-aef1-a2ec9c9ebb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:03.147198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:03.217804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 896/1756] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:03.218994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b52c7-deac-45c5-aef1-a2ec9c9ebb46 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:03.229338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 861/1757] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:03.229971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303208c-a980-4fe0-9143-5bb02fc68820 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:03.249928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4303208c-a980-4fe0-9143-5bb02fc68820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:03.475048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:03.497691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b52c7-deac-45c5-aef1-a2ec9c9ebb46 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:03.504798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ccda-a9b2-4f9f-9ebc-c9beb0ac03c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:03.505558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ccda-a9b2-4f9f-9ebc-c9beb0ac03c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:03.507474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ccda-a9b2-4f9f-9ebc-c9beb0ac03c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:03.507877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ccda-a9b2-4f9f-9ebc-c9beb0ac03c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:03.508786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5ccda-a9b2-4f9f-9ebc-c9beb0ac03c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:03.512230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5ccda-a9b2-4f9f-9ebc-c9beb0ac03c5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:03.523458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303208c-a980-4fe0-9143-5bb02fc68820 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:03.564268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf18596-872a-4404-aca0-d6096478fe2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:03.566324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18596-872a-4404-aca0-d6096478fe2d service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:03.566324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18596-872a-4404-aca0-d6096478fe2d service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:03.566324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18596-872a-4404-aca0-d6096478fe2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:03.583009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 897/1758] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:03 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:03.583412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ccda-a9b2-4f9f-9ebc-c9beb0ac03c5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:03.604407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ccda-a9b2-4f9f-9ebc-c9beb0ac03c5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:03.617710 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b7792-6985-450d-b78a-d6de1ad491b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:03.618395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b7792-6985-450d-b78a-d6de1ad491b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:03.618680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b7792-6985-450d-b78a-d6de1ad491b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:03.619099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b7792-6985-450d-b78a-d6de1ad491b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:03.620140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b7792-6985-450d-b78a-d6de1ad491b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:03.622231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b7792-6985-450d-b78a-d6de1ad491b0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:03.693334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 898/1759] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:03 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:03.693334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2fb8-f281-4958-a9c3-b00c2b13a4a5 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:03.696050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2fb8-f281-4958-a9c3-b00c2b13a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:03.696376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e2fb8-f281-4958-a9c3-b00c2b13a4a5 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:03.714149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 899/1760] 10.222.0.17 () {54 vars in 960 bytes} [Thu Jul 14 11:18:03 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:18:03.714149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e2fb8-f281-4958-a9c3-b00c2b13a4a5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:03.750179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf18596-872a-4404-aca0-d6096478fe2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:03.754438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf18596-872a-4404-aca0-d6096478fe2d service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:03.788460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 862/1761] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:03.794582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf18596-872a-4404-aca0-d6096478fe2d service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:03.821091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf18596-872a-4404-aca0-d6096478fe2d service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:03.905085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e2fb8-f281-4958-a9c3-b00c2b13a4a5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:03.925965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b0f4d-9141-4061-89f9-a8bb1845d85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:03.926677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0f4d-9141-4061-89f9-a8bb1845d85c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:03.926962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0f4d-9141-4061-89f9-a8bb1845d85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:03.927298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b0f4d-9141-4061-89f9-a8bb1845d85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:03.927987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b0f4d-9141-4061-89f9-a8bb1845d85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:03.929714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b0f4d-9141-4061-89f9-a8bb1845d85c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.023059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 900/1762] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:04.024502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff6c0-2143-49b7-ab46-3bd8906c5ea8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.024793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff6c0-2143-49b7-ab46-3bd8906c5ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.025073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaff6c0-2143-49b7-ab46-3bd8906c5ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.099954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fcaff6c0-2143-49b7-ab46-3bd8906c5ea8 None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:04.102100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fcaff6c0-2143-49b7-ab46-3bd8906c5ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:04.107426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546a420-5de4-4375-95b6-c7a6cdf2ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:04.108143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a420-5de4-4375-95b6-c7a6cdf2ced3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.108432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a420-5de4-4375-95b6-c7a6cdf2ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.108704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546a420-5de4-4375-95b6-c7a6cdf2ced3 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.109409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546a420-5de4-4375-95b6-c7a6cdf2ced3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:04.111766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546a420-5de4-4375-95b6-c7a6cdf2ced3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.167815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 863/1763] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:03 2022] POST /identity/v3/users => generated 293 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:04.173162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546a420-5de4-4375-95b6-c7a6cdf2ced3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:04.202398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:04.221593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546a420-5de4-4375-95b6-c7a6cdf2ced3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:04.251661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ad4c-cb6f-4665-9efa-e63105b8ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:04.254949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ad4c-cb6f-4665-9efa-e63105b8ef49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.255258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ad4c-cb6f-4665-9efa-e63105b8ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.255541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ad4c-cb6f-4665-9efa-e63105b8ef49 admin admin] PATH_INFO: `/v3/projects/3350330bcf9543efaf5d528f9951dcb3/users/48b5f891d7fd438db918e773dc47b840/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.286973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993ad4c-cb6f-4665-9efa-e63105b8ef49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3350330bcf9543efaf5d528f9951dcb3, user_id=48b5f891d7fd438db918e773dc47b840, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:04.291564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993ad4c-cb6f-4665-9efa-e63105b8ef49 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.305519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 901/1764] 10.222.0.17 () {58 vars in 1057 bytes} [Thu Jul 14 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:04.307126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff6c0-2143-49b7-ab46-3bd8906c5ea8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:04.308610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fcaff6c0-2143-49b7-ab46-3bd8906c5ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:04.319714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 864/1765] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:04 2022] PUT /identity/v3/projects/3350330bcf9543efaf5d528f9951dcb3/users/48b5f891d7fd438db918e773dc47b840/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:04.320583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ad4c-cb6f-4665-9efa-e63105b8ef49 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:04.341159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaff6c0-2143-49b7-ab46-3bd8906c5ea8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:04.461289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:04.485408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:04.486601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ad4c-cb6f-4665-9efa-e63105b8ef49 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:04.487508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.488279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.488794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.492946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:04.504031 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d0bbd-90ed-4399-b665-5ac4fd39bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:04.504818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d0bbd-90ed-4399-b665-5ac4fd39bef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.505102 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d0bbd-90ed-4399-b665-5ac4fd39bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.505379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d0bbd-90ed-4399-b665-5ac4fd39bef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.506122 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d0bbd-90ed-4399-b665-5ac4fd39bef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:04.507789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d0bbd-90ed-4399-b665-5ac4fd39bef1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.512830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:04.515646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.547960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 902/1766] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:04.549546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:04.589179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 865/1767] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:04.589179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d0bbd-90ed-4399-b665-5ac4fd39bef1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:04.597598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0b37-2ab0-497b-89bf-8b31ddf2b990 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:04.607672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d0bbd-90ed-4399-b665-5ac4fd39bef1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:04.615613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99692df9-7048-45a6-a458-255eab4ad5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:04.616181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692df9-7048-45a6-a458-255eab4ad5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.616602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692df9-7048-45a6-a458-255eab4ad5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.616886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99692df9-7048-45a6-a458-255eab4ad5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.617625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99692df9-7048-45a6-a458-255eab4ad5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:04.626046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99692df9-7048-45a6-a458-255eab4ad5e3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.628766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ed7a-b8cb-44f7-9a2f-ea0ac7989859 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:04.632252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ed7a-b8cb-44f7-9a2f-ea0ac7989859 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.632763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ed7a-b8cb-44f7-9a2f-ea0ac7989859 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.633501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5ed7a-b8cb-44f7-9a2f-ea0ac7989859 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.656874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 866/1768] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:04.657737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99692df9-7048-45a6-a458-255eab4ad5e3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:04.674071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5ed7a-b8cb-44f7-9a2f-ea0ac7989859 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:04.675783 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5ed7a-b8cb-44f7-9a2f-ea0ac7989859 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.680847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99692df9-7048-45a6-a458-255eab4ad5e3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:04.696541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30795788-34c1-46cb-a01f-aa9fb137c7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:04.698070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795788-34c1-46cb-a01f-aa9fb137c7de admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.698381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795788-34c1-46cb-a01f-aa9fb137c7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.698662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30795788-34c1-46cb-a01f-aa9fb137c7de admin admin] PATH_INFO: `/v3/projects/cb303952ed1a4d009a69b4b57e113a7c/users/8863c6c749ca47febfea3a57e2db94a2/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.732207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 903/1769] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:04.733441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ed7a-b8cb-44f7-9a2f-ea0ac7989859 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:04.779481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5ed7a-b8cb-44f7-9a2f-ea0ac7989859 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:04.784739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30795788-34c1-46cb-a01f-aa9fb137c7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb303952ed1a4d009a69b4b57e113a7c, user_id=8863c6c749ca47febfea3a57e2db94a2, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:04.809883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30795788-34c1-46cb-a01f-aa9fb137c7de admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.815804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691ce66-b411-4c5f-a642-c281044fc3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:04.816779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691ce66-b411-4c5f-a642-c281044fc3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.817211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691ce66-b411-4c5f-a642-c281044fc3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.817524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691ce66-b411-4c5f-a642-c281044fc3a7 admin admin] PATH_INFO: `/v3/projects/3350330bcf9543efaf5d528f9951dcb3/users/48b5f891d7fd438db918e773dc47b840/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:04.827208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691ce66-b411-4c5f-a642-c281044fc3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3350330bcf9543efaf5d528f9951dcb3, user_id=48b5f891d7fd438db918e773dc47b840, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:04.831041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691ce66-b411-4c5f-a642-c281044fc3a7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:04.858630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 867/1770] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:04 2022] PUT /identity/v3/projects/cb303952ed1a4d009a69b4b57e113a7c/users/8863c6c749ca47febfea3a57e2db94a2/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:04.862583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30795788-34c1-46cb-a01f-aa9fb137c7de admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:04.910974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 904/1771] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:04 2022] PUT /identity/v3/projects/3350330bcf9543efaf5d528f9951dcb3/users/48b5f891d7fd438db918e773dc47b840/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:04.914997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46b70-a7d8-4a31-a495-26b04ed28220 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:04.918858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46b70-a7d8-4a31-a495-26b04ed28220 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:04.921117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46b70-a7d8-4a31-a495-26b04ed28220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:05.026170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-70c46b70-a7d8-4a31-a495-26b04ed28220 None None] MFA Rules not processed for user `48b5f891d7fd438db918e773dc47b840`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:05.030376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-70c46b70-a7d8-4a31-a495-26b04ed28220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:05.208494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30795788-34c1-46cb-a01f-aa9fb137c7de admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:05.350924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:05.351936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 905/1772] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:05.358091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46b70-a7d8-4a31-a495-26b04ed28220 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:05.371399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:05.372678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:05.373512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:05.374073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:05.375244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:05.377440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:05.410522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 868/1773] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:05.411520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:05.418034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:05.573954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46b70-a7d8-4a31-a495-26b04ed28220 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:05.582639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:05.582874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:05.583100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:05.583387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] PATH_INFO: `/v3/users/78d91cf8dd27402ab10a3fcdd6274263` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:05.585921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d91cf8dd27402ab10a3fcdd6274263)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:05.589251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:05.667507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:05.675648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d91cf8dd27402ab10a3fcdd6274263'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:05.676484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d91cf8dd27402ab10a3fcdd6274263'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:05.695409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d91cf8dd27402ab10a3fcdd6274263'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:05.709512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27b159-88da-44d5-aca7-b282a0ff5775 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:05.725713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08238f5d-020d-47c8-8821-ee1269a46d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:05.726462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238f5d-020d-47c8-8821-ee1269a46d1d service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:05.726572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d91cf8dd27402ab10a3fcdd6274263'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:05.726884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238f5d-020d-47c8-8821-ee1269a46d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:05.728166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d91cf8dd27402ab10a3fcdd6274263'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:05.730929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08238f5d-020d-47c8-8821-ee1269a46d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:05.735935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-08238f5d-020d-47c8-8821-ee1269a46d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:05.766085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08238f5d-020d-47c8-8821-ee1269a46d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:05.767569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08238f5d-020d-47c8-8821-ee1269a46d1d service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:05.793619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 906/1774] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:05 2022] DELETE /identity/v3/users/78d91cf8dd27402ab10a3fcdd6274263 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:05.794015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 869/1775] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:05.796055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:05.799853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:05.810948 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126e6e9-e042-4c8f-a104-a04b501444f2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:05.811286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126e6e9-e042-4c8f-a104-a04b501444f2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:05.811576 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126e6e9-e042-4c8f-a104-a04b501444f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:05.919674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4c025-6407-4d9c-be3f-862dc00995c4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:05.929331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec00c-6f88-46ce-a35c-2198de34971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:05.930287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-7126e6e9-e042-4c8f-a104-a04b501444f2 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:05.931153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec00c-6f88-46ce-a35c-2198de34971e admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:05.932543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec00c-6f88-46ce-a35c-2198de34971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:05.932973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec00c-6f88-46ce-a35c-2198de34971e admin admin] PATH_INFO: `/v3/projects/cb303952ed1a4d009a69b4b57e113a7c/users/8863c6c749ca47febfea3a57e2db94a2/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:05.936937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec00c-6f88-46ce-a35c-2198de34971e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb303952ed1a4d009a69b4b57e113a7c, user_id=8863c6c749ca47febfea3a57e2db94a2, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:05.937114 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7126e6e9-e042-4c8f-a104-a04b501444f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:05.940927 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec00c-6f88-46ce-a35c-2198de34971e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:05.973214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 907/1776] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:05 2022] PUT /identity/v3/projects/cb303952ed1a4d009a69b4b57e113a7c/users/8863c6c749ca47febfea3a57e2db94a2/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:05.973214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93335-1bd2-4115-b93c-2c0e35188d72 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:05.973214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93335-1bd2-4115-b93c-2c0e35188d72 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:05.973214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93335-1bd2-4115-b93c-2c0e35188d72 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:05.973214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 908/1777] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:18:05.974874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 870/1778] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:05.978159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31e66-5eb7-4a2c-8a30-04e86aca4563 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:05.978159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31e66-5eb7-4a2c-8a30-04e86aca4563 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:05.978159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db31e66-5eb7-4a2c-8a30-04e86aca4563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:06.004392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106b02-f352-4f18-8bd1-481018676a58 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:06.004731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106b02-f352-4f18-8bd1-481018676a58 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:06.007364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c106b02-f352-4f18-8bd1-481018676a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:06.084585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3c106b02-f352-4f18-8bd1-481018676a58 None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:06.086640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7db31e66-5eb7-4a2c-8a30-04e86aca4563 None None] MFA Rules not processed for user `8863c6c749ca47febfea3a57e2db94a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:06.087553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3c106b02-f352-4f18-8bd1-481018676a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:06.090487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7db31e66-5eb7-4a2c-8a30-04e86aca4563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:06.311255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 871/1779] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:06.314172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106b02-f352-4f18-8bd1-481018676a58 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:06.319598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3c106b02-f352-4f18-8bd1-481018676a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:06.425458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 909/1780] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:06.425458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31e66-5eb7-4a2c-8a30-04e86aca4563 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:06.436559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7db31e66-5eb7-4a2c-8a30-04e86aca4563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:06.477611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c106b02-f352-4f18-8bd1-481018676a58 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:06.488832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063bec9-d53d-4d08-92a8-9f5e1d677d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:06.489575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063bec9-d53d-4d08-92a8-9f5e1d677d80 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:06.490439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063bec9-d53d-4d08-92a8-9f5e1d677d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:06.490646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db31e66-5eb7-4a2c-8a30-04e86aca4563 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:06.490748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063bec9-d53d-4d08-92a8-9f5e1d677d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:06.504471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:06.505521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:06.508218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:06.508840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:06.533212 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:06.540724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:06.581124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:06.593130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 910/1781] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:06.596393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:06.599264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:06.644071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063bec9-d53d-4d08-92a8-9f5e1d677d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:06.651389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063bec9-d53d-4d08-92a8-9f5e1d677d80 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:06.669045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 872/1782] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:06.708407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:06.773316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6a244-b408-48fc-b71f-152a98b22960 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:06.783536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:06.784730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:06.785023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:06.785356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:06.803675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:06.807336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:06.834624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 911/1783] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:07.834263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063bec9-d53d-4d08-92a8-9f5e1d677d80 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:07.855656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063bec9-d53d-4d08-92a8-9f5e1d677d80 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:07.871177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:07.872164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:07.872445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:07.874989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] PATH_INFO: `/v3/users/cbebf8301d7f441da881dbc92d3f911c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:07.878869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbebf8301d7f441da881dbc92d3f911c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:07.883504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:07.925943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:07.927537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:07.982146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e687ff6-0db5-4bc7-9f0d-b9ba4b0f9dbc service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:07.995526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:07.996488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:07.997786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:07.997786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] PATH_INFO: `/v3/users/fd660adcbc204ceca1d5e039ff1cfab1` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:08.003259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd660adcbc204ceca1d5e039ff1cfab1)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:08.006824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:08.029794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbebf8301d7f441da881dbc92d3f911c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.031246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbebf8301d7f441da881dbc92d3f911c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.064863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbebf8301d7f441da881dbc92d3f911c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.066919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbebf8301d7f441da881dbc92d3f911c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.081550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbebf8301d7f441da881dbc92d3f911c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.129242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 873/1784] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:07 2022] DELETE /identity/v3/users/cbebf8301d7f441da881dbc92d3f911c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:08.131579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:08.134146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:08.191159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd660adcbc204ceca1d5e039ff1cfab1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.193378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd660adcbc204ceca1d5e039ff1cfab1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.234109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd660adcbc204ceca1d5e039ff1cfab1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.274033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd660adcbc204ceca1d5e039ff1cfab1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.277948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c97fbf6c-0dea-49c9-8423-88a4b5ccc13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd660adcbc204ceca1d5e039ff1cfab1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:08.311069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 912/1785] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:07 2022] DELETE /identity/v3/users/fd660adcbc204ceca1d5e039ff1cfab1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:08.312614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed3430-c82a-4fd2-9ced-3add819c6222 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:08.312881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed3430-c82a-4fd2-9ced-3add819c6222 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:08.314034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed3430-c82a-4fd2-9ced-3add819c6222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:08.366900 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4bed3430-c82a-4fd2-9ced-3add819c6222 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:08.371736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4bed3430-c82a-4fd2-9ced-3add819c6222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:08.407549 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3387abe-08cc-4c2e-9fc9-148d71be01b1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:08.601242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 913/1786] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:08.693512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:08.767650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed3430-c82a-4fd2-9ced-3add819c6222 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:08.770229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4bed3430-c82a-4fd2-9ced-3add819c6222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:08.771497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:08.773011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:08.773800 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:08.776971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] PATH_INFO: `/v3/projects/8ef45fd6a76342f5b4abe3f10923b71a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:08.784641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef45fd6a76342f5b4abe3f10923b71a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:08.791465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:09.009390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef45fd6a76342f5b4abe3f10923b71a', 'request_id': 'req-efebe2cc-51a1-4247-9a4a-bfb39515342a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:09.031886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef45fd6a76342f5b4abe3f10923b71a', 'request_id': 'req-efebe2cc-51a1-4247-9a4a-bfb39515342a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:09.056500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef45fd6a76342f5b4abe3f10923b71a', 'request_id': 'req-efebe2cc-51a1-4247-9a4a-bfb39515342a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:09.064360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:09.094213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] The token cache is being invalidate because project 8ef45fd6a76342f5b4abe3f10923b71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:09.094789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:09.095841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-efebe2cc-51a1-4247-9a4a-bfb39515342a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:09.097839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 874/1787] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:08 2022] DELETE /identity/v3/projects/8ef45fd6a76342f5b4abe3f10923b71a => generated 0 bytes in 968 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:09.116645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ef48-e9c2-4637-adfd-9f3ead094748 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:09.118745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ef48-e9c2-4637-adfd-9f3ead094748 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:09.119701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ef48-e9c2-4637-adfd-9f3ead094748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:09.127035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed3430-c82a-4fd2-9ced-3add819c6222 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:09.202389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2d20ef48-e9c2-4637-adfd-9f3ead094748 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:09.205726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2d20ef48-e9c2-4637-adfd-9f3ead094748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:09.519539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d77f4-ecec-494d-be3f-f9b236a5afce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:09.521715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d77f4-ecec-494d-be3f-f9b236a5afce service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:09.523868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d77f4-ecec-494d-be3f-f9b236a5afce service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:09.524841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d77f4-ecec-494d-be3f-f9b236a5afce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:09.537478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c88d77f4-ecec-494d-be3f-f9b236a5afce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:09.623958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 875/1788] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:09.626175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ef48-e9c2-4637-adfd-9f3ead094748 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:09.629255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2d20ef48-e9c2-4637-adfd-9f3ead094748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:09.718660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ef48-e9c2-4637-adfd-9f3ead094748 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:09.759580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:09.761077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:09.780796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:09.781914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] PATH_INFO: `/v3/projects/cd6eaaa0f23b462193898eedb5a183d2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:09.808412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6eaaa0f23b462193898eedb5a183d2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:09.823965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:09.842376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d77f4-ecec-494d-be3f-f9b236a5afce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:09.845535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d77f4-ecec-494d-be3f-f9b236a5afce service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:09.913740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 914/1789] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:18:09.916976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499c16-7161-4083-b5ae-208773fc87f7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:09.917379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499c16-7161-4083-b5ae-208773fc87f7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:09.922558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72499c16-7161-4083-b5ae-208773fc87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:09.997121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-72499c16-7161-4083-b5ae-208773fc87f7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:10.000768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-72499c16-7161-4083-b5ae-208773fc87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:10.042702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6eaaa0f23b462193898eedb5a183d2', 'request_id': 'req-20647570-67f6-4c50-b2c3-c3ba929f34fc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.075861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6eaaa0f23b462193898eedb5a183d2', 'request_id': 'req-20647570-67f6-4c50-b2c3-c3ba929f34fc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.102185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6eaaa0f23b462193898eedb5a183d2', 'request_id': 'req-20647570-67f6-4c50-b2c3-c3ba929f34fc'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.127398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:10.156976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] The token cache is being invalidate because project cd6eaaa0f23b462193898eedb5a183d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:10.157829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.159672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-20647570-67f6-4c50-b2c3-c3ba929f34fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.169766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 876/1790] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:09 2022] DELETE /identity/v3/projects/cd6eaaa0f23b462193898eedb5a183d2 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:10.183779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea27dd8-61b5-4927-ae01-5fdc1d5d008e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:10.184384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea27dd8-61b5-4927-ae01-5fdc1d5d008e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:10.185777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea27dd8-61b5-4927-ae01-5fdc1d5d008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:10.332703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 915/1791] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:10.334199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72499c16-7161-4083-b5ae-208773fc87f7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:10.346701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-72499c16-7161-4083-b5ae-208773fc87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:10.425969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72499c16-7161-4083-b5ae-208773fc87f7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:10.470989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:10.479104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:10.479402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:10.479901 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] PATH_INFO: `/v3/users/637add54b1034ad799f946615fc6870f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:10.490719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=637add54b1034ad799f946615fc6870f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:10.507575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:10.519992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9ea27dd8-61b5-4927-ae01-5fdc1d5d008e None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:10.530007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9ea27dd8-61b5-4927-ae01-5fdc1d5d008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:10.609010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:10.612960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '637add54b1034ad799f946615fc6870f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.613951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '637add54b1034ad799f946615fc6870f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.639583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '637add54b1034ad799f946615fc6870f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.659467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '637add54b1034ad799f946615fc6870f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.660133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '637add54b1034ad799f946615fc6870f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:10.689399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 916/1792] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:10 2022] DELETE /identity/v3/users/637add54b1034ad799f946615fc6870f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:10.692502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:10.695488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:10.832367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415be2c-8f23-4351-b4fb-927c34396e13 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:10.835309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 877/1793] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:18:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 665 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:10.842767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea27dd8-61b5-4927-ae01-5fdc1d5d008e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:10.845491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9ea27dd8-61b5-4927-ae01-5fdc1d5d008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:10.851254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:10.852137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:10.852425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:10.852705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:10.856566 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:10.856998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:10.861225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:10.888919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea27dd8-61b5-4927-ae01-5fdc1d5d008e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:10.903072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 917/1794] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:10.908152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:10.913195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:10.915856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:10.916823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:10.918648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] PATH_INFO: `/v3/users/50677310f4074ffeb18626449c52a9cb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:10.931824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50677310f4074ffeb18626449c52a9cb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:10.932097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a88fc8-4f99-49fe-b6f9-0a8df07bcdaf admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:10.938370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:10.940867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed3cbd-6f4e-4c47-8e1f-d0ee4d252237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:10.941574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed3cbd-6f4e-4c47-8e1f-d0ee4d252237 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:10.942514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed3cbd-6f4e-4c47-8e1f-d0ee4d252237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:10.942514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed3cbd-6f4e-4c47-8e1f-d0ee4d252237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:10.942871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed3cbd-6f4e-4c47-8e1f-d0ee4d252237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:10.944991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed3cbd-6f4e-4c47-8e1f-d0ee4d252237 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:11.014944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 918/1795] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:11.020530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed3cbd-6f4e-4c47-8e1f-d0ee4d252237 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:11.173132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50677310f4074ffeb18626449c52a9cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:11.175951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50677310f4074ffeb18626449c52a9cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:11.216294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50677310f4074ffeb18626449c52a9cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:11.217790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50677310f4074ffeb18626449c52a9cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:11.238209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed3cbd-6f4e-4c47-8e1f-d0ee4d252237 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:11.241826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50677310f4074ffeb18626449c52a9cb'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:11.247744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb64fa-3ffe-4bcf-838d-e6c7af7a8419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:11.249311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb64fa-3ffe-4bcf-838d-e6c7af7a8419 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:11.249958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb64fa-3ffe-4bcf-838d-e6c7af7a8419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:11.250619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb64fa-3ffe-4bcf-838d-e6c7af7a8419 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:11.252138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb64fa-3ffe-4bcf-838d-e6c7af7a8419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:11.256825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb64fa-3ffe-4bcf-838d-e6c7af7a8419 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:11.284682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 878/1796] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:10 2022] DELETE /identity/v3/users/50677310f4074ffeb18626449c52a9cb => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:11.288421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:11.293455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:11.318060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 919/1797] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:11 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:11.320643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c750f-6edb-4425-8b12-111af7a027dd None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:11.321932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c750f-6edb-4425-8b12-111af7a027dd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:11.322574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c750f-6edb-4425-8b12-111af7a027dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:11.367364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-593c750f-6edb-4425-8b12-111af7a027dd None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:11.370274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-593c750f-6edb-4425-8b12-111af7a027dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:11.411879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:11.489533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:11.584563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 920/1798] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:11.586971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c750f-6edb-4425-8b12-111af7a027dd None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:11.591184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-593c750f-6edb-4425-8b12-111af7a027dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:11.635331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c750f-6edb-4425-8b12-111af7a027dd None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:11.645245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:11.646639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:11.647234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:11.647924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:11.649736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:11.652286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d019877-a370-4885-9d54-7c0cc3ac8f9f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:11.656226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:11.671464 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:11.672254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:11.672544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:11.673987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:11.684208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:11.717412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 921/1799] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:11.721454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:11.723902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:11.842210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dca4b-ff37-4165-81b6-8b0a94b77d1c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:11.847477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:11.849300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:11.849300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:11.849300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:11.863856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:11.865779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:11.887010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:11.887867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:11.910294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 879/1800] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:18:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:18:11.920628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 922/1801] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:11.921082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:11.924848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:11.930036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:11.967714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaa563-0629-48a3-a197-9d4e7193e6f0 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:11.976720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75722172-5988-4cbe-907b-5cec18cc035b service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:11.979662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f9d9f-faf4-44af-b66d-4ba2f386880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:11.981880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9d9f-faf4-44af-b66d-4ba2f386880c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:11.984965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9d9f-faf4-44af-b66d-4ba2f386880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:11.984965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9d9f-faf4-44af-b66d-4ba2f386880c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:11.986005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f9d9f-faf4-44af-b66d-4ba2f386880c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:12.000175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f9d9f-faf4-44af-b66d-4ba2f386880c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:12.009918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:12.011447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:12.011940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:12.012512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] PATH_INFO: `/v3/projects/348d160bc5db4313967c50624c4bfce1` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:12.020411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] RBAC: Authorizing `identity:delete_project(project_id=348d160bc5db4313967c50624c4bfce1)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:12.024727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:12.043791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 880/1802] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:12.045696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052b39-4e7b-4c41-8647-da9e9539e30a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:12.046128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052b39-4e7b-4c41-8647-da9e9539e30a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:12.046421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18052b39-4e7b-4c41-8647-da9e9539e30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:12.102084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-18052b39-4e7b-4c41-8647-da9e9539e30a None None] MFA Rules not processed for user `a367d904a4a44e91862da4aea28a123b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:12.108897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-18052b39-4e7b-4c41-8647-da9e9539e30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:12.137028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 881/1803] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Jul 14 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:12.140706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18052b39-4e7b-4c41-8647-da9e9539e30a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:12.146008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-18052b39-4e7b-4c41-8647-da9e9539e30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:12.173698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348d160bc5db4313967c50624c4bfce1', 'request_id': 'req-b05967a4-89b9-4196-9d6f-cc1150e6687a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.190954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348d160bc5db4313967c50624c4bfce1', 'request_id': 'req-b05967a4-89b9-4196-9d6f-cc1150e6687a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.199618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18052b39-4e7b-4c41-8647-da9e9539e30a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:12.247608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348d160bc5db4313967c50624c4bfce1', 'request_id': 'req-b05967a4-89b9-4196-9d6f-cc1150e6687a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.321227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] The token cache is being invalidate because project 348d160bc5db4313967c50624c4bfce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:12.322094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.327098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.341162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 923/1804] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:11 2022] DELETE /identity/v3/projects/348d160bc5db4313967c50624c4bfce1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:12.346566 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:12.355742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:12.387817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:12.388832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:12.389165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:12.389384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] PATH_INFO: `/v3/projects/b45d23fcd0b74f409922b2e5fc96eade` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:12.394041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45d23fcd0b74f409922b2e5fc96eade)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:12.398380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:12.568301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:12.610032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05967a4-89b9-4196-9d6f-cc1150e6687a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:12.625129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:12.631559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:12.633105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:12.633441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] PATH_INFO: `/v3/projects/f7310799f5b84cb489922271c0fea606/users/feb8033920564e3891698165418e4112/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:12.678589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7310799f5b84cb489922271c0fea606, user_id=feb8033920564e3891698165418e4112, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:12.684417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:12.726382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45d23fcd0b74f409922b2e5fc96eade', 'request_id': 'req-ef2150e6-28b9-4256-a127-f969b1ccc2f2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.726948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 924/1805] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:12 2022] PUT /identity/v3/projects/f7310799f5b84cb489922271c0fea606/users/feb8033920564e3891698165418e4112/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:12.728009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:12.734247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:12.740056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:12.755891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45d23fcd0b74f409922b2e5fc96eade', 'request_id': 'req-ef2150e6-28b9-4256-a127-f969b1ccc2f2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.801721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45d23fcd0b74f409922b2e5fc96eade', 'request_id': 'req-ef2150e6-28b9-4256-a127-f969b1ccc2f2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.819216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] The token cache is being invalidate because project b45d23fcd0b74f409922b2e5fc96eade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:12.820344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.823089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:12.830966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 882/1806] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:12 2022] DELETE /identity/v3/projects/b45d23fcd0b74f409922b2e5fc96eade => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:12.830966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:12.831988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:12.973173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da09339-f82b-401e-b2b4-fdc791fb22cb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:12.985902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf091437-bea6-4fe7-b0e4-f7a1ac405d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:12.987031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091437-bea6-4fe7-b0e4-f7a1ac405d04 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:12.987452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091437-bea6-4fe7-b0e4-f7a1ac405d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:12.987914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf091437-bea6-4fe7-b0e4-f7a1ac405d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:12.997650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bf091437-bea6-4fe7-b0e4-f7a1ac405d04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:13.024423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf091437-bea6-4fe7-b0e4-f7a1ac405d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:13.048728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf091437-bea6-4fe7-b0e4-f7a1ac405d04 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:13.108675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 925/1807] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:13.113477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bf109-2de8-4b36-95a4-6e20454803f6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:13.114918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2150e6-28b9-4256-a127-f969b1ccc2f2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:13.123065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bf109-2de8-4b36-95a4-6e20454803f6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:13.123771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bf109-2de8-4b36-95a4-6e20454803f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:13.291073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c80bf109-2de8-4b36-95a4-6e20454803f6 None None] MFA Rules not processed for user `feb8033920564e3891698165418e4112`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:13.296677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c80bf109-2de8-4b36-95a4-6e20454803f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:13.392478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:13.394756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:13.395293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:13.396228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] PATH_INFO: `/v3/users/8863c6c749ca47febfea3a57e2db94a2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:13.397797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8863c6c749ca47febfea3a57e2db94a2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:13.404897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:13.768064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8863c6c749ca47febfea3a57e2db94a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:13.771125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8863c6c749ca47febfea3a57e2db94a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:13.851390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 926/1808] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 736 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:13.852390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e4cd-31d8-4df0-bb5d-16c94a390bfc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:13.852550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e4cd-31d8-4df0-bb5d-16c94a390bfc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:13.852940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e4cd-31d8-4df0-bb5d-16c94a390bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:13.855272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8863c6c749ca47febfea3a57e2db94a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:13.858088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8863c6c749ca47febfea3a57e2db94a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:13.889473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8863c6c749ca47febfea3a57e2db94a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:13.954316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0468e4cd-31d8-4df0-bb5d-16c94a390bfc None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:13.961413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 883/1809] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:12 2022] DELETE /identity/v3/users/8863c6c749ca47febfea3a57e2db94a2 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:13.963514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:13.966255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:13.968657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0468e4cd-31d8-4df0-bb5d-16c94a390bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:13.977828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:14.073332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:14.124314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 927/1810] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:14.126029 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468e4cd-31d8-4df0-bb5d-16c94a390bfc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:14.139952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0468e4cd-31d8-4df0-bb5d-16c94a390bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:14.163301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468e4cd-31d8-4df0-bb5d-16c94a390bfc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:14.171283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452e721-8fe8-4085-a288-8253f0fb6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:14.172361 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e721-8fe8-4085-a288-8253f0fb6230 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:14.173197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e721-8fe8-4085-a288-8253f0fb6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:14.173687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452e721-8fe8-4085-a288-8253f0fb6230 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:14.193210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e721-8fe8-4085-a288-8253f0fb6230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:14.201735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452e721-8fe8-4085-a288-8253f0fb6230 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:14.247263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02adf0-5bb2-4e92-a75d-b92e8396075c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:14.260564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:14.261628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:14.262232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:14.262413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] PATH_INFO: `/v3/projects/a2b6cac9c8134204a7b15b3930d55393` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:14.264789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b6cac9c8134204a7b15b3930d55393)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:14.267370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:14.308626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 928/1811] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:14 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:14.310941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af0f6-5195-497b-b2b2-910d74630567 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:14.314791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af0f6-5195-497b-b2b2-910d74630567 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:14.316439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af0f6-5195-497b-b2b2-910d74630567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:14.377007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b6cac9c8134204a7b15b3930d55393', 'request_id': 'req-a942ba62-909e-4462-b75c-7bd25f93aa46'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.389591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b76af0f6-5195-497b-b2b2-910d74630567 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:14.392733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b6cac9c8134204a7b15b3930d55393', 'request_id': 'req-a942ba62-909e-4462-b75c-7bd25f93aa46'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.396589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b76af0f6-5195-497b-b2b2-910d74630567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:14.405903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b6cac9c8134204a7b15b3930d55393', 'request_id': 'req-a942ba62-909e-4462-b75c-7bd25f93aa46'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.428272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] The token cache is being invalidate because project a2b6cac9c8134204a7b15b3930d55393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:14.428686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.436704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.442173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 884/1812] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:13 2022] DELETE /identity/v3/projects/a2b6cac9c8134204a7b15b3930d55393 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:14.443617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:14.445369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:14.640669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 929/1813] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:14.641672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af0f6-5195-497b-b2b2-910d74630567 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:14.645453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b76af0f6-5195-497b-b2b2-910d74630567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:14.676774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af0f6-5195-497b-b2b2-910d74630567 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:14.698626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:14.699720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:14.700019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:14.700373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] PATH_INFO: `/v3/users/48b5f891d7fd438db918e773dc47b840` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:14.718382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b5f891d7fd438db918e773dc47b840)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:14.726436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ba62-909e-4462-b75c-7bd25f93aa46 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:14.727920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:14.773631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff90e51-c47d-4a47-9b4e-5afa08224825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:14.774459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff90e51-c47d-4a47-9b4e-5afa08224825 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:14.774879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff90e51-c47d-4a47-9b4e-5afa08224825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:14.775840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff90e51-c47d-4a47-9b4e-5afa08224825 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:14.776935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff90e51-c47d-4a47-9b4e-5afa08224825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:14.779516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff90e51-c47d-4a47-9b4e-5afa08224825 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:14.872811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 885/1814] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:14 2022] POST /identity/v3/users => generated 294 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:14.880580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff90e51-c47d-4a47-9b4e-5afa08224825 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:14.922146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b5f891d7fd438db918e773dc47b840'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.924296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b5f891d7fd438db918e773dc47b840'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.951836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff90e51-c47d-4a47-9b4e-5afa08224825 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:14.966518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:14.967701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:14.968479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b5f891d7fd438db918e773dc47b840'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.974374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:14.975053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:14.982358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:14.982997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:14.986517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:14.988077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b5f891d7fd438db918e773dc47b840'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:14.988916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b5f891d7fd438db918e773dc47b840'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:15.085231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 886/1815] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:15.093950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 930/1816] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:14 2022] DELETE /identity/v3/users/48b5f891d7fd438db918e773dc47b840 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:15.097610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:15.104329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:15.110509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:15.110784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:15.187385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef782e-2005-428f-b588-e44099df7643 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:15.244738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:15.294939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:15.351301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c65d9d-4911-4a3a-be10-561fa0a18b31 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:15.361678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56497441-9e7c-4b73-a359-df791c401628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:15.362431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56497441-9e7c-4b73-a359-df791c401628 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:15.362762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56497441-9e7c-4b73-a359-df791c401628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:15.363086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56497441-9e7c-4b73-a359-df791c401628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:15.363809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56497441-9e7c-4b73-a359-df791c401628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:15.366040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56497441-9e7c-4b73-a359-df791c401628 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:15.417012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 931/1817] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:15 2022] POST /identity/v3/projects => generated 363 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:15.427981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56497441-9e7c-4b73-a359-df791c401628 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:15.581087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ef4a-ccdb-4178-a4c5-583eecc4c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:15.585969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ef4a-ccdb-4178-a4c5-583eecc4c5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:15.593182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ef4a-ccdb-4178-a4c5-583eecc4c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:15.595104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757ef4a-ccdb-4178-a4c5-583eecc4c5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:15.597564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ef4a-ccdb-4178-a4c5-583eecc4c5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:15.605949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757ef4a-ccdb-4178-a4c5-583eecc4c5fb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:15.670518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 887/1818] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 578 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:15.675827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ef4a-ccdb-4178-a4c5-583eecc4c5fb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:15.732046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757ef4a-ccdb-4178-a4c5-583eecc4c5fb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:15.742629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56497441-9e7c-4b73-a359-df791c401628 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:15.746566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ecee7-e3ea-4481-9e1a-fcbceb17f7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:15.747627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ecee7-e3ea-4481-9e1a-fcbceb17f7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:15.747918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ecee7-e3ea-4481-9e1a-fcbceb17f7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:15.748272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ecee7-e3ea-4481-9e1a-fcbceb17f7a0 admin admin] PATH_INFO: `/v3/projects/f003587e5dbd44efabc024021c290d7d/users/c67624d15720443486d6195a119c3ca1/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:15.759865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05f163-0d07-406e-9d32-c00fc580afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:15.762933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f163-0d07-406e-9d32-c00fc580afb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:15.765328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f163-0d07-406e-9d32-c00fc580afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:15.765740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d05f163-0d07-406e-9d32-c00fc580afb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:15.766744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05f163-0d07-406e-9d32-c00fc580afb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:15.769475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d05f163-0d07-406e-9d32-c00fc580afb2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:15.809725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ecee7-e3ea-4481-9e1a-fcbceb17f7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f003587e5dbd44efabc024021c290d7d, user_id=c67624d15720443486d6195a119c3ca1, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:15.831805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ecee7-e3ea-4481-9e1a-fcbceb17f7a0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:15.870098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 932/1819] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:15 2022] POST /identity/v3/users => generated 282 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:15.886312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05f163-0d07-406e-9d32-c00fc580afb2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:15.919644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 888/1820] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:15 2022] PUT /identity/v3/projects/f003587e5dbd44efabc024021c290d7d/users/c67624d15720443486d6195a119c3ca1/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:15.927609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ecee7-e3ea-4481-9e1a-fcbceb17f7a0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:15.966318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d05f163-0d07-406e-9d32-c00fc580afb2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:16.317606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ecee7-e3ea-4481-9e1a-fcbceb17f7a0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:16.337473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81b63d-92f6-4a34-8062-6204d7995305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:16.337901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b63d-92f6-4a34-8062-6204d7995305 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:16.338238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b63d-92f6-4a34-8062-6204d7995305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:16.338562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b63d-92f6-4a34-8062-6204d7995305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:16.339334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81b63d-92f6-4a34-8062-6204d7995305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:16.341275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81b63d-92f6-4a34-8062-6204d7995305 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:16.354311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65e03b-5954-49b4-a83e-c8f78c1a6aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:16.355042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e03b-5954-49b4-a83e-c8f78c1a6aac admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:16.355385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e03b-5954-49b4-a83e-c8f78c1a6aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:16.355724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e03b-5954-49b4-a83e-c8f78c1a6aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:16.356712 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65e03b-5954-49b4-a83e-c8f78c1a6aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:16.372946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65e03b-5954-49b4-a83e-c8f78c1a6aac admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:16.388735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 889/1821] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:16.403354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81b63d-92f6-4a34-8062-6204d7995305 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:16.430209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 933/1822] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:16.435220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65e03b-5954-49b4-a83e-c8f78c1a6aac admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:16.459230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81b63d-92f6-4a34-8062-6204d7995305 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:16.477852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65e03b-5954-49b4-a83e-c8f78c1a6aac admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:16.489303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0888d-7209-44a9-a281-6eeb0797adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:16.490272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0888d-7209-44a9-a281-6eeb0797adb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:16.490664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0888d-7209-44a9-a281-6eeb0797adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:16.490962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0888d-7209-44a9-a281-6eeb0797adb6 admin admin] PATH_INFO: `/v3/projects/f003587e5dbd44efabc024021c290d7d/users/c67624d15720443486d6195a119c3ca1/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:16.496488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0888d-7209-44a9-a281-6eeb0797adb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f003587e5dbd44efabc024021c290d7d, user_id=c67624d15720443486d6195a119c3ca1, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:16.500991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdba617-8016-4fb3-8c94-a02222628099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:16.501768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdba617-8016-4fb3-8c94-a02222628099 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:16.504433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdba617-8016-4fb3-8c94-a02222628099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:16.504922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdba617-8016-4fb3-8c94-a02222628099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:16.505740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdba617-8016-4fb3-8c94-a02222628099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:16.507741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdba617-8016-4fb3-8c94-a02222628099 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:16.515042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0888d-7209-44a9-a281-6eeb0797adb6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:16.546103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 934/1823] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:16.551937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdba617-8016-4fb3-8c94-a02222628099 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:16.552161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 890/1824] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:16 2022] PUT /identity/v3/projects/f003587e5dbd44efabc024021c290d7d/users/c67624d15720443486d6195a119c3ca1/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:16.566693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc5f47-c25e-4689-9def-1cc30182e88d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:16.567665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc5f47-c25e-4689-9def-1cc30182e88d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:16.568238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc5f47-c25e-4689-9def-1cc30182e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:16.584877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdba617-8016-4fb3-8c94-a02222628099 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:16.660877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e1cc5f47-c25e-4689-9def-1cc30182e88d None None] MFA Rules not processed for user `c67624d15720443486d6195a119c3ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:16.663056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e1cc5f47-c25e-4689-9def-1cc30182e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:16.769745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:16.812881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab005e5a-7cb1-42d6-883f-103402b637af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:16.813817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab005e5a-7cb1-42d6-883f-103402b637af admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:16.814110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab005e5a-7cb1-42d6-883f-103402b637af admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:16.814487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab005e5a-7cb1-42d6-883f-103402b637af admin admin] PATH_INFO: `/v3/projects/ac5478d67b7445299451770a145d5104/users/d136fc5e93644a7e96993709d197a242/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:16.852235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab005e5a-7cb1-42d6-883f-103402b637af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5478d67b7445299451770a145d5104, user_id=d136fc5e93644a7e96993709d197a242, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:16.857829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab005e5a-7cb1-42d6-883f-103402b637af admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:16.892898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 935/1825] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:16 2022] PUT /identity/v3/projects/ac5478d67b7445299451770a145d5104/users/d136fc5e93644a7e96993709d197a242/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:16.892898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7058-4186-4007-b1a3-a4b750a04485 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:16.892898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7058-4186-4007-b1a3-a4b750a04485 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:16.892898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7058-4186-4007-b1a3-a4b750a04485 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:16.892898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 936/1826] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:18:16.908870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:16.913178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b9b69-d1a7-4c23-8803-7f384ef83a9a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:16.913649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b9b69-d1a7-4c23-8803-7f384ef83a9a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:16.914019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b9b69-d1a7-4c23-8803-7f384ef83a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:16.979191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 891/1827] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:18:17.003655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc5f47-c25e-4689-9def-1cc30182e88d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:17.006315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e1cc5f47-c25e-4689-9def-1cc30182e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:17.025563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-892b9b69-d1a7-4c23-8803-7f384ef83a9a None None] MFA Rules not processed for user `d136fc5e93644a7e96993709d197a242`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:17.026985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-892b9b69-d1a7-4c23-8803-7f384ef83a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:17.121591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc5f47-c25e-4689-9def-1cc30182e88d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:17.244908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:17.246269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:17.246881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:17.247364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:17.250757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:17.302660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 937/1828] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:17.305260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933f12-47f8-4247-86a3-db8022289218 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:17.305560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933f12-47f8-4247-86a3-db8022289218 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:17.305834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88933f12-47f8-4247-86a3-db8022289218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:17.385461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-88933f12-47f8-4247-86a3-db8022289218 None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:17.386634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-88933f12-47f8-4247-86a3-db8022289218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:17.430999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:17.437542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:17.479204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 892/1829] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:17.484698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:17.672288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 938/1830] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:18:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:17.752443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a1a4e-6945-46ec-9009-2ad4465d6251 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:17.779579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:17.781510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:17.781791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:17.782138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:17.783384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:17.789638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:17.804475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:17.896510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 893/1831] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:17 2022] POST /identity/v3/projects => generated 365 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:17.902142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88933f12-47f8-4247-86a3-db8022289218 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:17.923587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88933f12-47f8-4247-86a3-db8022289218 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:18.055866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:18.059103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:18.173234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:18.218679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:18.222786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:18.223042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:18.223419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:18.224863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:18.231410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:18.324851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 939/1832] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:17 2022] POST /identity/v3/users => generated 289 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:18.325270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:18.330102 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:18.390850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44ce63-50b0-4566-b9e2-c9f2fa023dad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:18.403957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f4934-3558-4a7b-87e7-70ae99686640 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:18.415094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62161b7e-5216-4fa5-ac7a-a0c571656786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:18.417386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62161b7e-5216-4fa5-ac7a-a0c571656786 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:18.419673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62161b7e-5216-4fa5-ac7a-a0c571656786 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:18.426213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62161b7e-5216-4fa5-ac7a-a0c571656786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:18.461928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62161b7e-5216-4fa5-ac7a-a0c571656786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:18.469190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62161b7e-5216-4fa5-ac7a-a0c571656786 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:18.485338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:18.486300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:18.486594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:18.486880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] PATH_INFO: `/v3/projects/cb303952ed1a4d009a69b4b57e113a7c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:18.495237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb303952ed1a4d009a69b4b57e113a7c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:18.497292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:18.511989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 894/1833] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:18.515533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62161b7e-5216-4fa5-ac7a-a0c571656786 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:18.560466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62161b7e-5216-4fa5-ac7a-a0c571656786 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:18.592863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e074cb8-ff13-4d43-bc42-143b7d6e31f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:18.598099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074cb8-ff13-4d43-bc42-143b7d6e31f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:18.599036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074cb8-ff13-4d43-bc42-143b7d6e31f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:18.600547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074cb8-ff13-4d43-bc42-143b7d6e31f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:18.602792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e074cb8-ff13-4d43-bc42-143b7d6e31f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:18.614651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e074cb8-ff13-4d43-bc42-143b7d6e31f4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:18.672081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 895/1834] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:18.679096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e074cb8-ff13-4d43-bc42-143b7d6e31f4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:18.718317 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e074cb8-ff13-4d43-bc42-143b7d6e31f4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:18.737080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb303952ed1a4d009a69b4b57e113a7c', 'request_id': 'req-21367294-a28f-4774-bc07-12515deafc17'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:18.789928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb303952ed1a4d009a69b4b57e113a7c', 'request_id': 'req-21367294-a28f-4774-bc07-12515deafc17'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:18.826772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb303952ed1a4d009a69b4b57e113a7c', 'request_id': 'req-21367294-a28f-4774-bc07-12515deafc17'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:18.848794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] The token cache is being invalidate because project cb303952ed1a4d009a69b4b57e113a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:18.849614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:18.850656 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-21367294-a28f-4774-bc07-12515deafc17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:18.861452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 940/1835] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:18 2022] DELETE /identity/v3/projects/cb303952ed1a4d009a69b4b57e113a7c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:18.866789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f01ce-dee2-4ad4-ad4e-3880236d9c0b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:18.870167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f01ce-dee2-4ad4-ad4e-3880236d9c0b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:18.871192 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f01ce-dee2-4ad4-ad4e-3880236d9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:18.951752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0a3f01ce-dee2-4ad4-ad4e-3880236d9c0b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:18.959868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0a3f01ce-dee2-4ad4-ad4e-3880236d9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:18.975214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:18.977669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:18.979953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:18.980798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] PATH_INFO: `/v3/projects/d8b9ce1395e24454823995a0247071ce/users/2f54cd087af74867852eead0aa2864a8/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:19.023077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 941/1836] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:19.026413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b9ce1395e24454823995a0247071ce, user_id=2f54cd087af74867852eead0aa2864a8, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:19.026597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d4bd-d38a-4a54-b5a0-108140abe069 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:19.027879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d4bd-d38a-4a54-b5a0-108140abe069 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:19.028347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d4bd-d38a-4a54-b5a0-108140abe069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:19.032645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:19.058858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 896/1837] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:18 2022] PUT /identity/v3/projects/d8b9ce1395e24454823995a0247071ce/users/2f54cd087af74867852eead0aa2864a8/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:19.065250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:19.070439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:19.093973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3b68d4bd-d38a-4a54-b5a0-108140abe069 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:19.095685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3b68d4bd-d38a-4a54-b5a0-108140abe069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:19.377408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:19.386488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 942/1838] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:19.390631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68d4bd-d38a-4a54-b5a0-108140abe069 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:19.424944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68d4bd-d38a-4a54-b5a0-108140abe069 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:19.442364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:19.444586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:19.445230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:19.445817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:19.449003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:19.452973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:19.460638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:19.512213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 943/1839] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:19.514499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:19.562744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c724-df18-467b-802a-9e9c6c6d4491 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:19.565146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13c37-f1fc-4d99-ac30-24a5aec28cc8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:19.583891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99524b8-862b-4712-8907-9687220ec447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:19.587360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99524b8-862b-4712-8907-9687220ec447 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:19.588822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99524b8-862b-4712-8907-9687220ec447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:19.588822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99524b8-862b-4712-8907-9687220ec447 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:19.590178 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99524b8-862b-4712-8907-9687220ec447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:19.597179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfea87-a447-40fb-9458-6977d2ab1ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:19.597920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfea87-a447-40fb-9458-6977d2ab1ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:19.598213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfea87-a447-40fb-9458-6977d2ab1ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:19.598499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfea87-a447-40fb-9458-6977d2ab1ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:19.599309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfea87-a447-40fb-9458-6977d2ab1ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:19.600821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99524b8-862b-4712-8907-9687220ec447 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:19.621990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfea87-a447-40fb-9458-6977d2ab1ec5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:19.672869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 897/1840] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 609 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:18:19.679650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfea87-a447-40fb-9458-6977d2ab1ec5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:19.715938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfea87-a447-40fb-9458-6977d2ab1ec5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:19.730523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 944/1841] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:19 2022] POST /identity/v3/projects => generated 369 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:19.734312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99524b8-862b-4712-8907-9687220ec447 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:19.737087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03d8fe-abba-47af-b534-94f20a1346bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:19.740613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d8fe-abba-47af-b534-94f20a1346bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:19.741022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d8fe-abba-47af-b534-94f20a1346bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:19.741201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d8fe-abba-47af-b534-94f20a1346bb admin admin] PATH_INFO: `/v3/projects/d8b9ce1395e24454823995a0247071ce/users/2f54cd087af74867852eead0aa2864a8/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:19.766431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03d8fe-abba-47af-b534-94f20a1346bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b9ce1395e24454823995a0247071ce, user_id=2f54cd087af74867852eead0aa2864a8, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:19.769667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03d8fe-abba-47af-b534-94f20a1346bb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:19.804266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 898/1842] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:19 2022] PUT /identity/v3/projects/d8b9ce1395e24454823995a0247071ce/users/2f54cd087af74867852eead0aa2864a8/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:19.827763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159ae0-b350-47e7-bdc0-4b391f1aae56 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:19.828060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159ae0-b350-47e7-bdc0-4b391f1aae56 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:19.828399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159ae0-b350-47e7-bdc0-4b391f1aae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:19.833749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:19.940173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e1159ae0-b350-47e7-bdc0-4b391f1aae56 None None] MFA Rules not processed for user `2f54cd087af74867852eead0aa2864a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:19.941579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e1159ae0-b350-47e7-bdc0-4b391f1aae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:20.214449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 899/1843] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:18:20.258893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1159ae0-b350-47e7-bdc0-4b391f1aae56 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:20.259195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99524b8-862b-4712-8907-9687220ec447 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:20.269444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e1159ae0-b350-47e7-bdc0-4b391f1aae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:20.453366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1159ae0-b350-47e7-bdc0-4b391f1aae56 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:20.469060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:20.470175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:20.470629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:20.471088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:20.507935 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99369a-60f5-47cc-8bec-ab4e9252eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:20.509127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99369a-60f5-47cc-8bec-ab4e9252eec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:20.510488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99369a-60f5-47cc-8bec-ab4e9252eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:20.511028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99369a-60f5-47cc-8bec-ab4e9252eec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:20.513029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:20.515904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:20.523678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99369a-60f5-47cc-8bec-ab4e9252eec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:20.527045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99369a-60f5-47cc-8bec-ab4e9252eec8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:20.571794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 900/1844] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:20.573776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:20.581593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:20.610117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 945/1845] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:19 2022] POST /identity/v3/users => generated 285 bytes in 879 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:20.616248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18332ece-9972-48c6-8130-541a515779a9 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:20.617257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99369a-60f5-47cc-8bec-ab4e9252eec8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:20.625393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:20.626966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:20.627510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:20.627996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] PATH_INFO: `/v3/projects/3350330bcf9543efaf5d528f9951dcb3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:20.630476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3350330bcf9543efaf5d528f9951dcb3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:20.634550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:20.678890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99369a-60f5-47cc-8bec-ab4e9252eec8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:20.717964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6a3b-ebd6-47f8-ac84-61bc6c3d7dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:20.723753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6a3b-ebd6-47f8-ac84-61bc6c3d7dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:20.724525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6a3b-ebd6-47f8-ac84-61bc6c3d7dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:20.726094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6a3b-ebd6-47f8-ac84-61bc6c3d7dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:20.727368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6a3b-ebd6-47f8-ac84-61bc6c3d7dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:20.729655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6a3b-ebd6-47f8-ac84-61bc6c3d7dd6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:20.780002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3350330bcf9543efaf5d528f9951dcb3', 'request_id': 'req-298bd37f-a40c-442e-960c-6b94f688df7a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:20.782247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:20.789136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 946/1846] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:20.798135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6a3b-ebd6-47f8-ac84-61bc6c3d7dd6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:20.801650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3350330bcf9543efaf5d528f9951dcb3', 'request_id': 'req-298bd37f-a40c-442e-960c-6b94f688df7a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:20.824472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3350330bcf9543efaf5d528f9951dcb3', 'request_id': 'req-298bd37f-a40c-442e-960c-6b94f688df7a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:20.844868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6a3b-ebd6-47f8-ac84-61bc6c3d7dd6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:20.863574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] The token cache is being invalidate because project 3350330bcf9543efaf5d528f9951dcb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:20.865496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:20.869488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:20.878592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 901/1847] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:20 2022] DELETE /identity/v3/projects/3350330bcf9543efaf5d528f9951dcb3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:20.879667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:20.884920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:21.198536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2ee40-bc66-4824-b43c-1eaaed70a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:21.218646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ee40-bc66-4824-b43c-1eaaed70a887 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:21.220701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ee40-bc66-4824-b43c-1eaaed70a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:21.222766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ee40-bc66-4824-b43c-1eaaed70a887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:21.229337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2ee40-bc66-4824-b43c-1eaaed70a887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:21.247862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298bd37f-a40c-442e-960c-6b94f688df7a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:21.249594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2ee40-bc66-4824-b43c-1eaaed70a887 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:21.279906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:21.283349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:21.283754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:21.284919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:21.288082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:21.336358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 947/1848] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:21.346079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc669d-11c0-4862-8081-cc264c2a93ca None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:21.347441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc669d-11c0-4862-8081-cc264c2a93ca None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:21.349685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc669d-11c0-4862-8081-cc264c2a93ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:21.439040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-09bc669d-11c0-4862-8081-cc264c2a93ca None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:21.441434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-09bc669d-11c0-4862-8081-cc264c2a93ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:21.468236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 948/1849] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:21.468236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc669d-11c0-4862-8081-cc264c2a93ca None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:21.471600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-09bc669d-11c0-4862-8081-cc264c2a93ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:21.502636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc669d-11c0-4862-8081-cc264c2a93ca None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:21.524702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59981e7-c392-442d-8b57-8e2589f6a5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:21.526450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59981e7-c392-442d-8b57-8e2589f6a5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:21.526592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59981e7-c392-442d-8b57-8e2589f6a5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:21.526774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59981e7-c392-442d-8b57-8e2589f6a5b7 admin admin] PATH_INFO: `/v3/projects/fed3d844e56b415781169b4f87bf1d19/users/548b75ac43ac42cf8db305f4b5fd0d64/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:21.535200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:21.544229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:21.579405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 902/1850] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:21.582824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:21.585805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59981e7-c392-442d-8b57-8e2589f6a5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed3d844e56b415781169b4f87bf1d19, user_id=548b75ac43ac42cf8db305f4b5fd0d64, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:21.587638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:21.591643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59981e7-c392-442d-8b57-8e2589f6a5b7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:21.617617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b559a2-1291-41ca-b6fe-17ece9b6eea7 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:21.642018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24eee42-34ab-48d1-8435-f84f5ffdafb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:21.643325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eee42-34ab-48d1-8435-f84f5ffdafb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:21.643925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eee42-34ab-48d1-8435-f84f5ffdafb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:21.644452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eee42-34ab-48d1-8435-f84f5ffdafb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:21.648719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a24eee42-34ab-48d1-8435-f84f5ffdafb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:21.709662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 949/1851] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:21 2022] PUT /identity/v3/projects/fed3d844e56b415781169b4f87bf1d19/users/548b75ac43ac42cf8db305f4b5fd0d64/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:21.712028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec441-6aa9-4bd9-a2b2-f73998cb8427 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:21.712625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec441-6aa9-4bd9-a2b2-f73998cb8427 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:21.713129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ec441-6aa9-4bd9-a2b2-f73998cb8427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:21.833246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b69ec441-6aa9-4bd9-a2b2-f73998cb8427 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:21.841065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b69ec441-6aa9-4bd9-a2b2-f73998cb8427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:21.865278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:21.895864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24eee42-34ab-48d1-8435-f84f5ffdafb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:21.898649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24eee42-34ab-48d1-8435-f84f5ffdafb2 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:21.946163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 903/1852] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:21.950060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594d86-8954-4db9-8603-e92977afdbe1 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:21.950603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594d86-8954-4db9-8603-e92977afdbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:21.951093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a594d86-8954-4db9-8603-e92977afdbe1 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:21.954369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 904/1853] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:18:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:18:21.957751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cedc74-3c46-4dae-8171-d261127d5095 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:21.958236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cedc74-3c46-4dae-8171-d261127d5095 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:21.958641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cedc74-3c46-4dae-8171-d261127d5095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:22.083659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c3cedc74-3c46-4dae-8171-d261127d5095 None None] MFA Rules not processed for user `548b75ac43ac42cf8db305f4b5fd0d64`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:22.095032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c3cedc74-3c46-4dae-8171-d261127d5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:22.123749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 950/1854] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:22.135402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b046f-c0b8-4e89-8c1e-da03611d1ec7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:22.135874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b046f-c0b8-4e89-8c1e-da03611d1ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:22.136133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b046f-c0b8-4e89-8c1e-da03611d1ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:22.158806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:22.180264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1f1b046f-c0b8-4e89-8c1e-da03611d1ec7 None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:22.182115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1f1b046f-c0b8-4e89-8c1e-da03611d1ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:22.443698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 905/1855] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:22.445272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cedc74-3c46-4dae-8171-d261127d5095 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:22.504477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 951/1856] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:22.507772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b046f-c0b8-4e89-8c1e-da03611d1ec7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:22.527036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cedc74-3c46-4dae-8171-d261127d5095 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:22.555330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:22.557063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b046f-c0b8-4e89-8c1e-da03611d1ec7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:22.560918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:22.563008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:22.564964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:22.566263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c0bd-a538-4f09-afb1-dfbf60746342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:22.567699 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c0bd-a538-4f09-afb1-dfbf60746342 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:22.568264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:22.568622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:22.569267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c0bd-a538-4f09-afb1-dfbf60746342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:22.570021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600c0bd-a538-4f09-afb1-dfbf60746342 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:22.572023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600c0bd-a538-4f09-afb1-dfbf60746342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:22.574205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:22.576728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600c0bd-a538-4f09-afb1-dfbf60746342 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:22.623528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 906/1857] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:22.624573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:22.657945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf712ed-a05c-4659-8c7a-5b0c1eba66ef admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:22.676988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65c1a-c13a-41db-a234-5df623884976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:22.677666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65c1a-c13a-41db-a234-5df623884976 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:22.677953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65c1a-c13a-41db-a234-5df623884976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:22.678318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea65c1a-c13a-41db-a234-5df623884976 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:22.678931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea65c1a-c13a-41db-a234-5df623884976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:22.693000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea65c1a-c13a-41db-a234-5df623884976 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:22.715567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 952/1858] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:22 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:22.718456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c0bd-a538-4f09-afb1-dfbf60746342 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:22.781698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 907/1859] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:22 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:22.785950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65c1a-c13a-41db-a234-5df623884976 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:22.974882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea65c1a-c13a-41db-a234-5df623884976 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:22.993583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a0bb-55f6-4769-a0d9-651864b9dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:22.998795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a0bb-55f6-4769-a0d9-651864b9dfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:23.001397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a0bb-55f6-4769-a0d9-651864b9dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:23.003842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688a0bb-55f6-4769-a0d9-651864b9dfb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:23.008216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688a0bb-55f6-4769-a0d9-651864b9dfb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:23.020423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600c0bd-a538-4f09-afb1-dfbf60746342 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:23.027694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688a0bb-55f6-4769-a0d9-651864b9dfb5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:23.043427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:23.044574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:23.045059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:23.045551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:23.048254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:23.070158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:23.113842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 908/1860] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:22 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:23.116839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a0bb-55f6-4769-a0d9-651864b9dfb5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:23.167347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688a0bb-55f6-4769-a0d9-651864b9dfb5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:23.186444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 953/1861] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:22 2022] POST /identity/v3/users => generated 290 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:23.188915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:23.196298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:23.199161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271b3d2-2ebc-4bcd-8111-c26278c3e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:23.201802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271b3d2-2ebc-4bcd-8111-c26278c3e5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:23.203005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271b3d2-2ebc-4bcd-8111-c26278c3e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:23.205604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271b3d2-2ebc-4bcd-8111-c26278c3e5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:23.207595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271b3d2-2ebc-4bcd-8111-c26278c3e5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:23.222967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271b3d2-2ebc-4bcd-8111-c26278c3e5d5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:23.229783 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df8998-1c4d-4ee9-9ff6-3151c6c5de52 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:23.244703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:23.246575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:23.247053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:23.247535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] PATH_INFO: `/v3/users/c5d22b5076444e77a47e11ba7aad1b54` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:23.249938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d22b5076444e77a47e11ba7aad1b54)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:23.253609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:23.265153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 909/1862] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:23.272707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271b3d2-2ebc-4bcd-8111-c26278c3e5d5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:23.285291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:23.297981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271b3d2-2ebc-4bcd-8111-c26278c3e5d5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:23.310002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c71c2-e525-4856-9563-d1b52540332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:23.314374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c71c2-e525-4856-9563-d1b52540332b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:23.315923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c71c2-e525-4856-9563-d1b52540332b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:23.316914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c71c2-e525-4856-9563-d1b52540332b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:23.319830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c71c2-e525-4856-9563-d1b52540332b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:23.326847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c71c2-e525-4856-9563-d1b52540332b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:23.378070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 910/1863] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:23.380381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c71c2-e525-4856-9563-d1b52540332b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:23.433985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c71c2-e525-4856-9563-d1b52540332b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:23.440010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d22b5076444e77a47e11ba7aad1b54'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:23.441226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d22b5076444e77a47e11ba7aad1b54'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:23.443378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:23.444945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:23.445567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:23.445951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:23.448042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:23.451245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:23.471388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d22b5076444e77a47e11ba7aad1b54'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:23.495277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d22b5076444e77a47e11ba7aad1b54'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:23.499895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d22b5076444e77a47e11ba7aad1b54'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:23.502868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 911/1864] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:23.507085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:23.521297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:23.605086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 954/1865] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:23 2022] DELETE /identity/v3/users/c5d22b5076444e77a47e11ba7aad1b54 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:23.606663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:23.609492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:23.813468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:23.921806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716db0fc-00f3-4f1b-98bd-70d45a31409c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:23.949631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:23.954458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:23.954966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:23.955435 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] PATH_INFO: `/v3/projects/011e7264d38249ab98401615f93d324b/users/79a4dfff63ab4a4485f75ac14b4cae10/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:23.996799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63336fb-e364-4c74-ad59-4829b58fc141 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:24.069409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011e7264d38249ab98401615f93d324b, user_id=79a4dfff63ab4a4485f75ac14b4cae10, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:24.089033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:24.138882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 955/1866] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:23 2022] PUT /identity/v3/projects/011e7264d38249ab98401615f93d324b/users/79a4dfff63ab4a4485f75ac14b4cae10/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:24.141744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:24.148546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:24.309667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286b462-0e75-4959-a7ae-df6744808260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:24.310471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b462-0e75-4959-a7ae-df6744808260 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:24.310914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b462-0e75-4959-a7ae-df6744808260 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:24.311098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b462-0e75-4959-a7ae-df6744808260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:24.323161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1286b462-0e75-4959-a7ae-df6744808260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:24.349629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286b462-0e75-4959-a7ae-df6744808260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:24.351002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286b462-0e75-4959-a7ae-df6744808260 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:24.368483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 912/1867] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 863 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:24.371121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708744-3e44-4394-b70b-55a488e43d06 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:24.371457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708744-3e44-4394-b70b-55a488e43d06 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:24.371960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708744-3e44-4394-b70b-55a488e43d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:24.401712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1b708744-3e44-4394-b70b-55a488e43d06 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:24.405390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1b708744-3e44-4394-b70b-55a488e43d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:24.490204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd5167-651e-497c-8e02-99eb5fdb1221 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:24.520476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcd060-1494-4362-ac3b-8dafbbac2dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:24.527931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcd060-1494-4362-ac3b-8dafbbac2dff admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:24.529324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcd060-1494-4362-ac3b-8dafbbac2dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:24.530382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bcd060-1494-4362-ac3b-8dafbbac2dff admin admin] PATH_INFO: `/v3/projects/0bbc10933e6c4b41991812b9e489ba44/users/edc1f913c36e4d88acc91a966197eab3/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:24.579138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:24.602370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcd060-1494-4362-ac3b-8dafbbac2dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbc10933e6c4b41991812b9e489ba44, user_id=edc1f913c36e4d88acc91a966197eab3, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:24.610630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bcd060-1494-4362-ac3b-8dafbbac2dff admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:24.664180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 956/1868] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:24 2022] PUT /identity/v3/projects/0bbc10933e6c4b41991812b9e489ba44/users/edc1f913c36e4d88acc91a966197eab3/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:24.666308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcd060-1494-4362-ac3b-8dafbbac2dff admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:24.692454 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 913/1869] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:24.694882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c90906-8f75-442f-952e-f9bae2a6a777 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:24.695545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c90906-8f75-442f-952e-f9bae2a6a777 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:24.696049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c90906-8f75-442f-952e-f9bae2a6a777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:24.801848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-75c90906-8f75-442f-952e-f9bae2a6a777 None None] MFA Rules not processed for user `edc1f913c36e4d88acc91a966197eab3`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:24.805541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-75c90906-8f75-442f-952e-f9bae2a6a777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:24.918245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bcd060-1494-4362-ac3b-8dafbbac2dff admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:24.942023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:24.942725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:24.943008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:24.943287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:24.944048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:24.945725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:25.014994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 957/1870] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:25.017046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:25.025607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:25.110620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:25.171799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 914/1871] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:25.171799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c90906-8f75-442f-952e-f9bae2a6a777 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:25.197752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c90906-8f75-442f-952e-f9bae2a6a777 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:25.223615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5630b83-625d-4b3e-a13d-3079b89dad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:25.224760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5630b83-625d-4b3e-a13d-3079b89dad09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:25.226497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5630b83-625d-4b3e-a13d-3079b89dad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:25.226899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5630b83-625d-4b3e-a13d-3079b89dad09 admin admin] PATH_INFO: `/v3/projects/011e7264d38249ab98401615f93d324b/users/79a4dfff63ab4a4485f75ac14b4cae10/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:25.233055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5630b83-625d-4b3e-a13d-3079b89dad09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011e7264d38249ab98401615f93d324b, user_id=79a4dfff63ab4a4485f75ac14b4cae10, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:25.236011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5630b83-625d-4b3e-a13d-3079b89dad09 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:25.237432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39900706-c554-4bd0-929a-602268e5f381 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:25.247334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559beb1f-2d8b-464a-a640-a30382631a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:25.248197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559beb1f-2d8b-464a-a640-a30382631a26 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:25.248974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559beb1f-2d8b-464a-a640-a30382631a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:25.249917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559beb1f-2d8b-464a-a640-a30382631a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:25.265660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 915/1872] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:25 2022] PUT /identity/v3/projects/011e7264d38249ab98401615f93d324b/users/79a4dfff63ab4a4485f75ac14b4cae10/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:25.266815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5630b83-625d-4b3e-a13d-3079b89dad09 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:25.273175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559beb1f-2d8b-464a-a640-a30382631a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:25.277039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559beb1f-2d8b-464a-a640-a30382631a26 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:25.303959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 958/1873] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:25.305617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b944ab6-9e41-41e2-9b69-58d91c65b569 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:25.306723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b944ab6-9e41-41e2-9b69-58d91c65b569 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:25.307103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b944ab6-9e41-41e2-9b69-58d91c65b569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:25.363578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5b944ab6-9e41-41e2-9b69-58d91c65b569 None None] MFA Rules not processed for user `79a4dfff63ab4a4485f75ac14b4cae10`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:25.366568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5b944ab6-9e41-41e2-9b69-58d91c65b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:25.434651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5630b83-625d-4b3e-a13d-3079b89dad09 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:25.445977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789254dd-8860-43e3-a543-6d759d4c6e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:25.448284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789254dd-8860-43e3-a543-6d759d4c6e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:25.449889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789254dd-8860-43e3-a543-6d759d4c6e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:25.450276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789254dd-8860-43e3-a543-6d759d4c6e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:25.453098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789254dd-8860-43e3-a543-6d759d4c6e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:25.458327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789254dd-8860-43e3-a543-6d759d4c6e46 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:25.528191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 916/1874] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:25 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:25.535277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789254dd-8860-43e3-a543-6d759d4c6e46 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:25.547871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 959/1875] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:25.564536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b944ab6-9e41-41e2-9b69-58d91c65b569 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:25.566231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5b944ab6-9e41-41e2-9b69-58d91c65b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:25.597639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:25.675026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789254dd-8860-43e3-a543-6d759d4c6e46 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:25.685849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcce01-4752-4ab1-9e2b-2a28aea8c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:25.686551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcce01-4752-4ab1-9e2b-2a28aea8c396 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:25.686836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcce01-4752-4ab1-9e2b-2a28aea8c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:25.687115 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcce01-4752-4ab1-9e2b-2a28aea8c396 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:25.687850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcce01-4752-4ab1-9e2b-2a28aea8c396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:25.690329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcce01-4752-4ab1-9e2b-2a28aea8c396 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:25.698518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b944ab6-9e41-41e2-9b69-58d91c65b569 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:25.744478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 917/1876] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:25 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:18:25.753071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcce01-4752-4ab1-9e2b-2a28aea8c396 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:25.803686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcce01-4752-4ab1-9e2b-2a28aea8c396 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:25.817387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99522f6-980f-4ca1-9fdc-4c7fd4b85ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:25.817387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99522f6-980f-4ca1-9fdc-4c7fd4b85ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:25.817387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99522f6-980f-4ca1-9fdc-4c7fd4b85ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:25.817387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99522f6-980f-4ca1-9fdc-4c7fd4b85ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:25.818115 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99522f6-980f-4ca1-9fdc-4c7fd4b85ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:25.824739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99522f6-980f-4ca1-9fdc-4c7fd4b85ca7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:25.886410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 918/1877] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:25.888273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99522f6-980f-4ca1-9fdc-4c7fd4b85ca7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:25.925385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:25.925690 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:25.926306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:25.926916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:25.955547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99522f6-980f-4ca1-9fdc-4c7fd4b85ca7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:25.987197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e836f-9b34-4f0a-8d67-e3a35a734e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:25.989142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e836f-9b34-4f0a-8d67-e3a35a734e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:25.989142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e836f-9b34-4f0a-8d67-e3a35a734e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:25.989142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e836f-9b34-4f0a-8d67-e3a35a734e6d admin admin] PATH_INFO: `/v3/projects/cbb7317c14c946cd9c2264d2af6b7996/users/7a2e7885ecd24b8198c85ef7d4367d4a/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:26.036417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e836f-9b34-4f0a-8d67-e3a35a734e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb7317c14c946cd9c2264d2af6b7996, user_id=7a2e7885ecd24b8198c85ef7d4367d4a, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:26.039398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e836f-9b34-4f0a-8d67-e3a35a734e6d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:26.074143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 919/1878] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:25 2022] PUT /identity/v3/projects/cbb7317c14c946cd9c2264d2af6b7996/users/7a2e7885ecd24b8198c85ef7d4367d4a/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:26.075321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e836f-9b34-4f0a-8d67-e3a35a734e6d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:26.112895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:26.153117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:26.154600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:26.197395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 960/1879] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:18:26.217772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e836f-9b34-4f0a-8d67-e3a35a734e6d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:26.239246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656f99-5ccf-4367-a87e-b8a365436a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:26.240269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656f99-5ccf-4367-a87e-b8a365436a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:26.240697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656f99-5ccf-4367-a87e-b8a365436a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:26.241194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75656f99-5ccf-4367-a87e-b8a365436a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:26.242277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75656f99-5ccf-4367-a87e-b8a365436a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:26.245763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75656f99-5ccf-4367-a87e-b8a365436a17 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:26.296851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 920/1880] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:26.297082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:26.297082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:26.311469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656f99-5ccf-4367-a87e-b8a365436a17 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:26.329570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80a61-ff1a-44c0-ab5e-35a40f6fd83b service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:26.339329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75656f99-5ccf-4367-a87e-b8a365436a17 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:26.346706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:26.348444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:26.348963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:26.349334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] PATH_INFO: `/v3/projects/cbb7317c14c946cd9c2264d2af6b7996/users/7a2e7885ecd24b8198c85ef7d4367d4a/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:26.356871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb7317c14c946cd9c2264d2af6b7996, user_id=7a2e7885ecd24b8198c85ef7d4367d4a, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:26.371970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:26.420704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 921/1881] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:26 2022] PUT /identity/v3/projects/cbb7317c14c946cd9c2264d2af6b7996/users/7a2e7885ecd24b8198c85ef7d4367d4a/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:26.424506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:26.426807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:26.454914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:26.456202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:26.456651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:26.457344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:26.460495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:26.513632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:26.554027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3ac62-38a6-43ca-9d87-9b84cf8a3ee5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:26.561946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:26.564579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:26.566373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:26.570397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:26.570799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:26.572361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] PATH_INFO: `/v3/projects/db7583f0014546d68341b60d3055d371` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:26.573060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7583f0014546d68341b60d3055d371)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:26.575201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:26.589797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 961/1882] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:18:26.590850 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:26.594855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:26.631587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8530b6b-8c1e-4cc1-8c93-f68e9aa76f49 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:26.644323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:26.645331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:26.645755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:26.646185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] PATH_INFO: `/v3/users/d136fc5e93644a7e96993709d197a242` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:26.647928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d136fc5e93644a7e96993709d197a242)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:26.651427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:26.689896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7583f0014546d68341b60d3055d371', 'request_id': 'req-e5522844-cdfa-493b-976b-0373d69563b1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.698329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7583f0014546d68341b60d3055d371', 'request_id': 'req-e5522844-cdfa-493b-976b-0373d69563b1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.709151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7583f0014546d68341b60d3055d371', 'request_id': 'req-e5522844-cdfa-493b-976b-0373d69563b1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.733496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] The token cache is being invalidate because project db7583f0014546d68341b60d3055d371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:26.734711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.745776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e5522844-cdfa-493b-976b-0373d69563b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.748156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 922/1883] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:26 2022] DELETE /identity/v3/projects/db7583f0014546d68341b60d3055d371 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:26.761459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e86f0-9ffd-48f7-b21e-597d1fee34de None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:26.762363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd136fc5e93644a7e96993709d197a242'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.762884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e86f0-9ffd-48f7-b21e-597d1fee34de None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:26.763114 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e86f0-9ffd-48f7-b21e-597d1fee34de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:26.764769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd136fc5e93644a7e96993709d197a242'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.777844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd136fc5e93644a7e96993709d197a242'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.799546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd136fc5e93644a7e96993709d197a242'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.800533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd136fc5e93644a7e96993709d197a242'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:26.831767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-678e86f0-9ffd-48f7-b21e-597d1fee34de None None] MFA Rules not processed for user `7a2e7885ecd24b8198c85ef7d4367d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:26.837094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-678e86f0-9ffd-48f7-b21e-597d1fee34de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:26.842089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 962/1884] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:26 2022] DELETE /identity/v3/users/d136fc5e93644a7e96993709d197a242 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:26.845643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:26.847067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:26.895905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:26.968221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffb303-d324-41b1-a7d2-a24606c4fc90 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:26.974559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:26.975550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:26.975842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:26.976150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] PATH_INFO: `/v3/users/e7a650d4492e4c2eb28ba7ecb35ae63a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:26.978638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a650d4492e4c2eb28ba7ecb35ae63a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:26.980718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:26.994365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 923/1885] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:26.996713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c851fd9-668a-40fe-a56e-0e46a81fb36a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:26.997135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c851fd9-668a-40fe-a56e-0e46a81fb36a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:26.997655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c851fd9-668a-40fe-a56e-0e46a81fb36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:27.021041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2c851fd9-668a-40fe-a56e-0e46a81fb36a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:27.022627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2c851fd9-668a-40fe-a56e-0e46a81fb36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.033400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 924/1886] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:27.034366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c851fd9-668a-40fe-a56e-0e46a81fb36a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:27.036390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2c851fd9-668a-40fe-a56e-0e46a81fb36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.057451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a650d4492e4c2eb28ba7ecb35ae63a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.058414 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a650d4492e4c2eb28ba7ecb35ae63a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.060413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:27.072465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a650d4492e4c2eb28ba7ecb35ae63a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.082208 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a650d4492e4c2eb28ba7ecb35ae63a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.083054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a650d4492e4c2eb28ba7ecb35ae63a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.111804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 963/1887] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:26 2022] DELETE /identity/v3/users/e7a650d4492e4c2eb28ba7ecb35ae63a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:27.111804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:27.126285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.160168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c851fd9-668a-40fe-a56e-0e46a81fb36a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:27.218876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c571-d61f-427a-b90a-410cb1fa0b93 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:27.224338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:27.225211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:27.225603 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:27.226025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:27.228781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.256538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:27.257563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:27.257849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:27.258254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:27.261380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.310531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:27.312058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:27.323527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 964/1888] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:27.359940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:27.361810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:27.373740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 925/1889] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:27.458619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:27.460390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.476364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef81120-fe0f-492c-a903-bfb34875b4d8 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:27.484550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:27.486099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:27.486608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:27.487125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] PATH_INFO: `/v3/users/edc1f913c36e4d88acc91a966197eab3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:27.490080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc1f913c36e4d88acc91a966197eab3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:27.494396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:27.586540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc1f913c36e4d88acc91a966197eab3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.589639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc1f913c36e4d88acc91a966197eab3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.605724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:27.605724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.614722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc1f913c36e4d88acc91a966197eab3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.631224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc1f913c36e4d88acc91a966197eab3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.632496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3b8838cd-8a0a-452c-a289-e8fcf2f9baf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc1f913c36e4d88acc91a966197eab3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.633579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9a682-6bab-4ae7-94ae-ceb3bfc6261c service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:27.643264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:27.647861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:27.648843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:27.649472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:27.649472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] PATH_INFO: `/v3/projects/51f5ef50d0da43dd8c0fc37fe2814efb` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:27.651759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f5ef50d0da43dd8c0fc37fe2814efb)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:27.653770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:27.675031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 965/1890] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:27 2022] DELETE /identity/v3/users/edc1f913c36e4d88acc91a966197eab3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:27.680495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:27.682880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3c7d-fc7c-4222-ae3d-812507fdf747 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:27.683299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3c7d-fc7c-4222-ae3d-812507fdf747 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:27.683820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3c7d-fc7c-4222-ae3d-812507fdf747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:27.714931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3f9b3c7d-fc7c-4222-ae3d-812507fdf747 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:27.718360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3f9b3c7d-fc7c-4222-ae3d-812507fdf747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.741957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f5ef50d0da43dd8c0fc37fe2814efb', 'request_id': 'req-b83e6f97-1748-42b8-afeb-52efa73a2c00'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.750407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f5ef50d0da43dd8c0fc37fe2814efb', 'request_id': 'req-b83e6f97-1748-42b8-afeb-52efa73a2c00'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.759021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f5ef50d0da43dd8c0fc37fe2814efb', 'request_id': 'req-b83e6f97-1748-42b8-afeb-52efa73a2c00'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.794471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] The token cache is being invalidate because project 51f5ef50d0da43dd8c0fc37fe2814efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:27.794471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.804812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b83e6f97-1748-42b8-afeb-52efa73a2c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:27.813949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 966/1891] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:18:27.814478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 926/1892] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:27 2022] DELETE /identity/v3/projects/51f5ef50d0da43dd8c0fc37fe2814efb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:27.814760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3c7d-fc7c-4222-ae3d-812507fdf747 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:27.814760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3f9b3c7d-fc7c-4222-ae3d-812507fdf747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.814898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c9fa-161c-4e1a-b3f1-8f63261506ea None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:27.814898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c9fa-161c-4e1a-b3f1-8f63261506ea None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:27.814898 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084c9fa-161c-4e1a-b3f1-8f63261506ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:27.836721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4084c9fa-161c-4e1a-b3f1-8f63261506ea None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:27.838153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4084c9fa-161c-4e1a-b3f1-8f63261506ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:27.854752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3c7d-fc7c-4222-ae3d-812507fdf747 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:27.967128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:27.968490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:27.968778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:27.969105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] PATH_INFO: `/v3/projects/ac5478d67b7445299451770a145d5104` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:27.983040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5478d67b7445299451770a145d5104)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:27.989410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.006191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 927/1893] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:28.007512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084c9fa-161c-4e1a-b3f1-8f63261506ea None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.015134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4084c9fa-161c-4e1a-b3f1-8f63261506ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:28.127533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5478d67b7445299451770a145d5104', 'request_id': 'req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.137231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084c9fa-161c-4e1a-b3f1-8f63261506ea None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:28.137491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5478d67b7445299451770a145d5104', 'request_id': 'req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.148852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5478d67b7445299451770a145d5104', 'request_id': 'req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.170738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] The token cache is being invalidate because project ac5478d67b7445299451770a145d5104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:28.171565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.172523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-df550c8f-7916-46a4-bb5c-dac89e1f7bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.175058 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 967/1894] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:27 2022] DELETE /identity/v3/projects/ac5478d67b7445299451770a145d5104 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:28.177257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feee16-4ad5-42d6-aedf-8a8b1d196941 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.177695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feee16-4ad5-42d6-aedf-8a8b1d196941 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.178068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80feee16-4ad5-42d6-aedf-8a8b1d196941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.205291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-80feee16-4ad5-42d6-aedf-8a8b1d196941 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:28.206972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-80feee16-4ad5-42d6-aedf-8a8b1d196941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:28.219035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:28.219722 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.220006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.220320 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.222718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:28.232433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:28.233413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:28.309931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:28.320149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.327647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 968/1895] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:28.328641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feee16-4ad5-42d6-aedf-8a8b1d196941 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.330551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-80feee16-4ad5-42d6-aedf-8a8b1d196941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:28.340654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 928/1896] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:28.342655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.343678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80feee16-4ad5-42d6-aedf-8a8b1d196941 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:28.350314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:28.353644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.354043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.354227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] PATH_INFO: `/v3/users/2f54cd087af74867852eead0aa2864a8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.357984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f54cd087af74867852eead0aa2864a8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:28.359900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa8aa7-0b4d-4122-bd05-045bd6e429a9 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:28.361545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.372153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:28.372366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.372559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.372841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.373779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:28.374090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:28.375750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.389839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 929/1897] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:28.395244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.407014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf72c2-dd7f-43de-b91b-4c487535198b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:28.413444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:28.414594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.414888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.415168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.416666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:28.418876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.440701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f54cd087af74867852eead0aa2864a8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.441653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f54cd087af74867852eead0aa2864a8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.453681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f54cd087af74867852eead0aa2864a8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.459248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 930/1898] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:28 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:18:28.463747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f54cd087af74867852eead0aa2864a8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.464003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.465270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f54cd087af74867852eead0aa2864a8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:28.465939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:28.496640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 969/1899] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:28 2022] DELETE /identity/v3/users/2f54cd087af74867852eead0aa2864a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:28.559717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157fbe7-d974-4a8e-8795-09fea6745c7a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:28.680363 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058b55-e320-4d55-8660-b06461faa6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:28.682000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058b55-e320-4d55-8660-b06461faa6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.682775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058b55-e320-4d55-8660-b06461faa6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.683243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e058b55-e320-4d55-8660-b06461faa6ea admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.684341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e058b55-e320-4d55-8660-b06461faa6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:28.687809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e058b55-e320-4d55-8660-b06461faa6ea admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.725201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 931/1900] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:28 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:28.730179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.745762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402a218-bf0b-49a1-9898-ba9ad82dc358 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:28.755278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39ed02-e498-4dc4-af7f-6c869bd22a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:28.757127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ed02-e498-4dc4-af7f-6c869bd22a15 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.757497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ed02-e498-4dc4-af7f-6c869bd22a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.757887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39ed02-e498-4dc4-af7f-6c869bd22a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.763474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39ed02-e498-4dc4-af7f-6c869bd22a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:28.768390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39ed02-e498-4dc4-af7f-6c869bd22a15 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.789936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 970/1901] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:28.794485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058b55-e320-4d55-8660-b06461faa6ea admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.808956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e058b55-e320-4d55-8660-b06461faa6ea admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:28.816637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9abcf-cf2e-4fa1-8da3-3040343667c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:28.817335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9abcf-cf2e-4fa1-8da3-3040343667c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.817619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9abcf-cf2e-4fa1-8da3-3040343667c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.817896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9abcf-cf2e-4fa1-8da3-3040343667c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.819402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9abcf-cf2e-4fa1-8da3-3040343667c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:28.821705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9abcf-cf2e-4fa1-8da3-3040343667c3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.823905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:28.845824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 932/1902] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:18:28.850275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39ed02-e498-4dc4-af7f-6c869bd22a15 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.863357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39ed02-e498-4dc4-af7f-6c869bd22a15 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:28.871384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:28.872675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.875062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.876066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] PATH_INFO: `/v3/projects/f5a472acb7c44871b0b38ecde0fa0ebc/users/e38a6a776a474f55a567b0769d46dc4d/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.902545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a472acb7c44871b0b38ecde0fa0ebc, user_id=e38a6a776a474f55a567b0769d46dc4d, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:28.906413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:28.932019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 971/1903] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:28 2022] PUT /identity/v3/projects/f5a472acb7c44871b0b38ecde0fa0ebc/users/e38a6a776a474f55a567b0769d46dc4d/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:28.942893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdf572-9511-43d3-b59f-39c544bc18c2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:28.943277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdf572-9511-43d3-b59f-39c544bc18c2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:28.943646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdf572-9511-43d3-b59f-39c544bc18c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:28.988236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:28.994207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.027329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c3fdf572-9511-43d3-b59f-39c544bc18c2 None None] MFA Rules not processed for user `e38a6a776a474f55a567b0769d46dc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:29.032341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c3fdf572-9511-43d3-b59f-39c544bc18c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.125385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:29.137047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae904f0b-4211-44ef-8619-022603cff291 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.153303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.154740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.155362 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.156072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] PATH_INFO: `/v3/projects/d8b9ce1395e24454823995a0247071ce` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.157874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b9ce1395e24454823995a0247071ce)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:29.171840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:29.229274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 933/1904] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:29.230404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdf572-9511-43d3-b59f-39c544bc18c2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:29.249758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdf572-9511-43d3-b59f-39c544bc18c2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.259224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.260264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.260574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.261369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.275147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:29.278268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:29.290291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b9ce1395e24454823995a0247071ce', 'request_id': 'req-51ef1a63-c9ed-4707-977c-7ee5f93129fa'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.330048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b9ce1395e24454823995a0247071ce', 'request_id': 'req-51ef1a63-c9ed-4707-977c-7ee5f93129fa'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.342148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 934/1905] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:29 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:29.343332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:29.346630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b9ce1395e24454823995a0247071ce', 'request_id': 'req-51ef1a63-c9ed-4707-977c-7ee5f93129fa'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.346807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.362654 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] The token cache is being invalidate because project d8b9ce1395e24454823995a0247071ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:29.363469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.364552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.367114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 972/1906] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:28 2022] DELETE /identity/v3/projects/d8b9ce1395e24454823995a0247071ce => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:29.369721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:29.378193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.428084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f2f25-e5d5-422b-bbe4-5595fe55c3fa admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.433889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.434880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.435187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.435424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] PATH_INFO: `/v3/projects/0bbc10933e6c4b41991812b9e489ba44` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.436913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bbc10933e6c4b41991812b9e489ba44)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:29.439123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:29.508911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bbc10933e6c4b41991812b9e489ba44', 'request_id': 'req-bda5b583-0890-488b-a0ed-b1b93104abe9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.532342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef1a63-c9ed-4707-977c-7ee5f93129fa admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.538951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bbc10933e6c4b41991812b9e489ba44', 'request_id': 'req-bda5b583-0890-488b-a0ed-b1b93104abe9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.554027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bbc10933e6c4b41991812b9e489ba44', 'request_id': 'req-bda5b583-0890-488b-a0ed-b1b93104abe9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.556161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:29.591285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] The token cache is being invalidate because project 0bbc10933e6c4b41991812b9e489ba44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:29.591655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.593782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bda5b583-0890-488b-a0ed-b1b93104abe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.599904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 935/1907] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:29 2022] DELETE /identity/v3/projects/0bbc10933e6c4b41991812b9e489ba44 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:29.599904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1bbc-a6bc-4818-a088-878de0b70538 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.599904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1bbc-a6bc-4818-a088-878de0b70538 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.599904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1bbc-a6bc-4818-a088-878de0b70538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.623288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bf2b1bbc-a6bc-4818-a088-878de0b70538 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:29.625133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bf2b1bbc-a6bc-4818-a088-878de0b70538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.656173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.657483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.658579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.658907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.659634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:29.662424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:29.700819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 973/1908] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:29 2022] POST /identity/v3/users => generated 297 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:29.702029 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:29.703761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.729827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff982de-de85-4393-917c-2b40799e26a4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.735841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.736922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.737309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.737482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] PATH_INFO: `/v3/users/7a2e7885ecd24b8198c85ef7d4367d4a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.739214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2e7885ecd24b8198c85ef7d4367d4a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:29.741254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:29.769588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:29.782091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 936/1909] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:29.791379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1bbc-a6bc-4818-a088-878de0b70538 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:29.792938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bf2b1bbc-a6bc-4818-a088-878de0b70538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.805435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1bbc-a6bc-4818-a088-878de0b70538 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.808920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2e7885ecd24b8198c85ef7d4367d4a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.809589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2e7885ecd24b8198c85ef7d4367d4a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.810103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4a7fe-07ef-4f0d-be7c-d82f95f06626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.810803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4a7fe-07ef-4f0d-be7c-d82f95f06626 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.811066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4a7fe-07ef-4f0d-be7c-d82f95f06626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.811340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4a7fe-07ef-4f0d-be7c-d82f95f06626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.812071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4a7fe-07ef-4f0d-be7c-d82f95f06626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:29.813725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4a7fe-07ef-4f0d-be7c-d82f95f06626 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:29.817139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2e7885ecd24b8198c85ef7d4367d4a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.828150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 937/1910] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:29.828150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460c197-c4a7-4e48-b20f-f8b4c83dbfbe None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.828150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460c197-c4a7-4e48-b20f-f8b4c83dbfbe None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.828150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460c197-c4a7-4e48-b20f-f8b4c83dbfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.829730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2e7885ecd24b8198c85ef7d4367d4a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.830355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2e7885ecd24b8198c85ef7d4367d4a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:29.846545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1460c197-c4a7-4e48-b20f-f8b4c83dbfbe None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:29.847765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1460c197-c4a7-4e48-b20f-f8b4c83dbfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.851160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 974/1911] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:29 2022] DELETE /identity/v3/users/7a2e7885ecd24b8198c85ef7d4367d4a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:29.851997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:29.854059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:29.931321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 938/1912] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:29.936739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460c197-c4a7-4e48-b20f-f8b4c83dbfbe None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:29.943580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30833e3-14ac-4c49-a6d1-9cdc829509a1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.948318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460c197-c4a7-4e48-b20f-f8b4c83dbfbe None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.954006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc0b4-8333-4ea4-be5d-18c7e0a39113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.954183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.955230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.955230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.955519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.955621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc0b4-8333-4ea4-be5d-18c7e0a39113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.956056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc0b4-8333-4ea4-be5d-18c7e0a39113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.956506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:29.956659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebfc0b4-8333-4ea4-be5d-18c7e0a39113 admin admin] PATH_INFO: `/v3/projects/ef2c270af9d745c384b7bb57046a6226/users/e3810cd357ac41cd93b1550fb3511eac/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:29.956851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:29.958563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:29.973461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 939/1913] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:29.979756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:29.986466 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfc0b4-8333-4ea4-be5d-18c7e0a39113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2c270af9d745c384b7bb57046a6226, user_id=e3810cd357ac41cd93b1550fb3511eac, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:29.989849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebfc0b4-8333-4ea4-be5d-18c7e0a39113 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:29.990568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e85e10-a289-4424-a157-fef6d64480bc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:29.997353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afc10-279c-4732-9a31-9b34fccfe6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:29.998457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afc10-279c-4732-9a31-9b34fccfe6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:29.998748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afc10-279c-4732-9a31-9b34fccfe6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:29.999464 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afc10-279c-4732-9a31-9b34fccfe6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.000380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1afc10-279c-4732-9a31-9b34fccfe6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.002364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1afc10-279c-4732-9a31-9b34fccfe6e2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.016249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 975/1914] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:29 2022] PUT /identity/v3/projects/ef2c270af9d745c384b7bb57046a6226/users/e3810cd357ac41cd93b1550fb3511eac/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:30.017223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc0b4-8333-4ea4-be5d-18c7e0a39113 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.054065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 940/1915] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:29 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:18:30.055679 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afc10-279c-4732-9a31-9b34fccfe6e2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.121968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:30.128906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebfc0b4-8333-4ea4-be5d-18c7e0a39113 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.142867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afc10-279c-4732-9a31-9b34fccfe6e2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.150202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384f9eb-870e-4d33-a80b-12ec52383b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.151301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f9eb-870e-4d33-a80b-12ec52383b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.151653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f9eb-870e-4d33-a80b-12ec52383b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.152158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384f9eb-870e-4d33-a80b-12ec52383b6b admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.153069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384f9eb-870e-4d33-a80b-12ec52383b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.155905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384f9eb-870e-4d33-a80b-12ec52383b6b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.171764 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:30.183599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 941/1916] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:30 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:18:30.190596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384f9eb-870e-4d33-a80b-12ec52383b6b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.216598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384f9eb-870e-4d33-a80b-12ec52383b6b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.234402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282e80-efec-4510-a98f-d6f05cdce3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.236018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282e80-efec-4510-a98f-d6f05cdce3da admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.237284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282e80-efec-4510-a98f-d6f05cdce3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.237841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff282e80-efec-4510-a98f-d6f05cdce3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.239197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff282e80-efec-4510-a98f-d6f05cdce3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.242890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff282e80-efec-4510-a98f-d6f05cdce3da admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.251064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.251847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.252257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.252614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.253731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.255778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.270606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 976/1917] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:30.271695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.273796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:30.282979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 942/1918] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:30.284804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282e80-efec-4510-a98f-d6f05cdce3da admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.294400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e3da1-8b5b-4f98-b08a-488b81c32846 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.301743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.302189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.302483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.302760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] PATH_INFO: `/v3/projects/cbb7317c14c946cd9c2264d2af6b7996` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.305791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff282e80-efec-4510-a98f-d6f05cdce3da admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.308655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb7317c14c946cd9c2264d2af6b7996)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.310614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.318259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61601b0-0307-4286-bb6a-52d672f8b0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.320708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61601b0-0307-4286-bb6a-52d672f8b0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.321278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61601b0-0307-4286-bb6a-52d672f8b0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.321586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61601b0-0307-4286-bb6a-52d672f8b0bc admin admin] PATH_INFO: `/v3/projects/ef2c270af9d745c384b7bb57046a6226/users/e3810cd357ac41cd93b1550fb3511eac/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.324188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61601b0-0307-4286-bb6a-52d672f8b0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2c270af9d745c384b7bb57046a6226, user_id=e3810cd357ac41cd93b1550fb3511eac, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.327367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61601b0-0307-4286-bb6a-52d672f8b0bc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.342374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 943/1919] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:30 2022] PUT /identity/v3/projects/ef2c270af9d745c384b7bb57046a6226/users/e3810cd357ac41cd93b1550fb3511eac/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:30.343455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61601b0-0307-4286-bb6a-52d672f8b0bc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.383762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb7317c14c946cd9c2264d2af6b7996', 'request_id': 'req-98b45cf1-79fc-48e7-851e-d384a90e8af5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:30.392228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb7317c14c946cd9c2264d2af6b7996', 'request_id': 'req-98b45cf1-79fc-48e7-851e-d384a90e8af5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:30.401894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb7317c14c946cd9c2264d2af6b7996', 'request_id': 'req-98b45cf1-79fc-48e7-851e-d384a90e8af5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:30.420443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] The token cache is being invalidate because project cbb7317c14c946cd9c2264d2af6b7996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:30.420746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:30.421499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-98b45cf1-79fc-48e7-851e-d384a90e8af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:30.421611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61601b0-0307-4286-bb6a-52d672f8b0bc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.423905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 977/1920] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:30 2022] DELETE /identity/v3/projects/cbb7317c14c946cd9c2264d2af6b7996 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:30.429708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f89ec-16ca-44e8-853c-7931acdc437c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.430675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f89ec-16ca-44e8-853c-7931acdc437c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.430675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f89ec-16ca-44e8-853c-7931acdc437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.460896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e28f89ec-16ca-44e8-853c-7931acdc437c None None] MFA Rules not processed for user `e3810cd357ac41cd93b1550fb3511eac`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:30.462319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e28f89ec-16ca-44e8-853c-7931acdc437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:30.511588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2cfcb-98e2-4aa6-8e0a-4724ae077bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.515630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2cfcb-98e2-4aa6-8e0a-4724ae077bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.515938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2cfcb-98e2-4aa6-8e0a-4724ae077bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.516254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2cfcb-98e2-4aa6-8e0a-4724ae077bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.517033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2cfcb-98e2-4aa6-8e0a-4724ae077bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.518698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2cfcb-98e2-4aa6-8e0a-4724ae077bdc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.550127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 944/1921] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:30.550844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1fcee-5b46-4310-9e91-4289dbe94521 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.551208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1fcee-5b46-4310-9e91-4289dbe94521 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.551502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1fcee-5b46-4310-9e91-4289dbe94521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.573818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f8a1fcee-5b46-4310-9e91-4289dbe94521 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:30.575053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f8a1fcee-5b46-4310-9e91-4289dbe94521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:30.590078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 945/1922] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:30.591284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1fcee-5b46-4310-9e91-4289dbe94521 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.593104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f8a1fcee-5b46-4310-9e91-4289dbe94521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:30.599300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 978/1923] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:30.600688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74f20-3f07-4832-873f-4eb67e4ff2b6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.600991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74f20-3f07-4832-873f-4eb67e4ff2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.601272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74f20-3f07-4832-873f-4eb67e4ff2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.616655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1fcee-5b46-4310-9e91-4289dbe94521 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.625379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e608e-f2de-4453-acc0-a7d240703c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.626965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e608e-f2de-4453-acc0-a7d240703c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.627532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e608e-f2de-4453-acc0-a7d240703c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.628829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e608e-f2de-4453-acc0-a7d240703c06 admin admin] PATH_INFO: `/v3/projects/ce1500545c4945049f2811300a1c65c8/users/b76b5dce34164ffd9f28432b5d41c0dd/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.636542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1da74f20-3f07-4832-873f-4eb67e4ff2b6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:30.638104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1da74f20-3f07-4832-873f-4eb67e4ff2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:30.657971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 979/1924] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:30.657971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da74f20-3f07-4832-873f-4eb67e4ff2b6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.659867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1da74f20-3f07-4832-873f-4eb67e4ff2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:30.666098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e608e-f2de-4453-acc0-a7d240703c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1500545c4945049f2811300a1c65c8, user_id=b76b5dce34164ffd9f28432b5d41c0dd, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.670563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e608e-f2de-4453-acc0-a7d240703c06 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.713117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 946/1925] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:30 2022] PUT /identity/v3/projects/ce1500545c4945049f2811300a1c65c8/users/b76b5dce34164ffd9f28432b5d41c0dd/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:30.713117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e608e-f2de-4453-acc0-a7d240703c06 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:30.731097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:30.771866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:30.780360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da74f20-3f07-4832-873f-4eb67e4ff2b6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.829794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e608e-f2de-4453-acc0-a7d240703c06 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:30.835533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d770-2d50-4114-bd9c-b7aab71a1e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.836813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d770-2d50-4114-bd9c-b7aab71a1e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.838527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d770-2d50-4114-bd9c-b7aab71a1e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.838860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d770-2d50-4114-bd9c-b7aab71a1e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.839645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d770-2d50-4114-bd9c-b7aab71a1e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:30.840090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d770-2d50-4114-bd9c-b7aab71a1e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:30.842253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d770-2d50-4114-bd9c-b7aab71a1e26 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:30.862899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 947/1926] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:30.864604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d9ff-ab1e-4381-8fd9-ccad6742c184 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.865068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d9ff-ab1e-4381-8fd9-ccad6742c184 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.865650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123d9ff-ab1e-4381-8fd9-ccad6742c184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.903918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3c54c-9392-44a8-8477-9353d75b15b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:30.904791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3c54c-9392-44a8-8477-9353d75b15b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:30.904961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3c54c-9392-44a8-8477-9353d75b15b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:30.905250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3c54c-9392-44a8-8477-9353d75b15b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:30.910911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b123d9ff-ab1e-4381-8fd9-ccad6742c184 None None] MFA Rules not processed for user `b76b5dce34164ffd9f28432b5d41c0dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:30.914183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b123d9ff-ab1e-4381-8fd9-ccad6742c184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:31.003151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3c54c-9392-44a8-8477-9353d75b15b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.004846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3c54c-9392-44a8-8477-9353d75b15b5 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.017923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 980/1927] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:31.032915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3c54c-9392-44a8-8477-9353d75b15b5 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.056325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3c54c-9392-44a8-8477-9353d75b15b5 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.074648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.076892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.077579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.082955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.088040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 948/1928] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:31.088357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.088357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.089992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123d9ff-ab1e-4381-8fd9-ccad6742c184 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.124718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123d9ff-ab1e-4381-8fd9-ccad6742c184 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.136767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa931-d1ac-44b6-839a-cb55006dc77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.138075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa931-d1ac-44b6-839a-cb55006dc77b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.139140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa931-d1ac-44b6-839a-cb55006dc77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.139654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afa931-d1ac-44b6-839a-cb55006dc77b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.141099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afa931-d1ac-44b6-839a-cb55006dc77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.145241 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afa931-d1ac-44b6-839a-cb55006dc77b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.184250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 981/1929] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:31 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:31.185494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.188328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:31.203253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 949/1930] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:31 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:31.204323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa931-d1ac-44b6-839a-cb55006dc77b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.309874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afa931-d1ac-44b6-839a-cb55006dc77b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.313015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8997f0-83cb-4dea-8a57-ec5039917fa7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.314860 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8de10-01a3-4a7d-a7c1-7090205352de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.315621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8de10-01a3-4a7d-a7c1-7090205352de admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.315984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8de10-01a3-4a7d-a7c1-7090205352de admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.316302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8de10-01a3-4a7d-a7c1-7090205352de admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.317006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8de10-01a3-4a7d-a7c1-7090205352de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.318950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8de10-01a3-4a7d-a7c1-7090205352de admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.322747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.323847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.324155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.324443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] PATH_INFO: `/v3/users/548b75ac43ac42cf8db305f4b5fd0d64` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.325719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548b75ac43ac42cf8db305f4b5fd0d64)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.328881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.336270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:31.351039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 950/1931] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:31 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:31.353399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8de10-01a3-4a7d-a7c1-7090205352de admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.371830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8de10-01a3-4a7d-a7c1-7090205352de admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.381236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.382158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.382566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.382945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.383763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.385899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.392586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548b75ac43ac42cf8db305f4b5fd0d64'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:31.393630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548b75ac43ac42cf8db305f4b5fd0d64'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:31.403757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:31.404170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548b75ac43ac42cf8db305f4b5fd0d64'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:31.413443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 951/1932] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:31 2022] POST /identity/v3/users => generated 299 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:31.414491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.415880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548b75ac43ac42cf8db305f4b5fd0d64'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:31.416929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:31.417115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548b75ac43ac42cf8db305f4b5fd0d64'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:31.432308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57a32-87a6-4e74-9147-e4d9eff67810 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.438121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16cf0-bc60-410d-832c-99ddffdf5d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.438837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16cf0-bc60-410d-832c-99ddffdf5d49 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.439403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16cf0-bc60-410d-832c-99ddffdf5d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.439690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16cf0-bc60-410d-832c-99ddffdf5d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.440468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16cf0-bc60-410d-832c-99ddffdf5d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.442337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 982/1933] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:31 2022] DELETE /identity/v3/users/548b75ac43ac42cf8db305f4b5fd0d64 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:31.442531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16cf0-bc60-410d-832c-99ddffdf5d49 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.443097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.445165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:31.458534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 952/1934] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:31.458534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf5af9-20f4-4fe1-a4ba-12ed25852631 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.458534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf5af9-20f4-4fe1-a4ba-12ed25852631 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.458534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf5af9-20f4-4fe1-a4ba-12ed25852631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.487627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-97bf5af9-20f4-4fe1-a4ba-12ed25852631 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:31.490512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-97bf5af9-20f4-4fe1-a4ba-12ed25852631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:31.550329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bf92a-ff77-4905-9326-eb63f13d8df5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.556692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f8fe-8e46-4ca9-94e0-0caaa797c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.557374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f8fe-8e46-4ca9-94e0-0caaa797c86b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.557842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f8fe-8e46-4ca9-94e0-0caaa797c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.558019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f8fe-8e46-4ca9-94e0-0caaa797c86b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.558675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6f8fe-8e46-4ca9-94e0-0caaa797c86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.560501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6f8fe-8e46-4ca9-94e0-0caaa797c86b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.572500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 983/1935] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:31.573410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f8fe-8e46-4ca9-94e0-0caaa797c86b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.585568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f8fe-8e46-4ca9-94e0-0caaa797c86b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.586487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 953/1936] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:31.591723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf5af9-20f4-4fe1-a4ba-12ed25852631 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.593915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.594982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.595172 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.595440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.596297 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.598119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.608798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf5af9-20f4-4fe1-a4ba-12ed25852631 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.611480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 984/1937] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:31.612379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.614631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:31.616257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.618024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.618535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.618969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] PATH_INFO: `/v3/projects/9810ad72a24e48f098c7f68b6a0ff0ef/users/891ad55303cb46d3ba2afb843070d545/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.645920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9810ad72a24e48f098c7f68b6a0ff0ef, user_id=891ad55303cb46d3ba2afb843070d545, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.651522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.673106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 954/1938] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:31 2022] PUT /identity/v3/projects/9810ad72a24e48f098c7f68b6a0ff0ef/users/891ad55303cb46d3ba2afb843070d545/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:31.675236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.678228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:31.711286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbea1fc-5934-461e-9f28-4ec34431d98e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.755479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:31.785129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235147e-630c-47f1-b02a-bcb61a5dcaee admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.791989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3810cd357ac41cd93b1550fb3511eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef2c270af9d745c384b7bb57046a6226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.792729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.793287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.793287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.794473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:31.795023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.797113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.799292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219400d-e685-43cd-a8ed-660b32c65a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.800631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219400d-e685-43cd-a8ed-660b32c65a47 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.801206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219400d-e685-43cd-a8ed-660b32c65a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.801838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219400d-e685-43cd-a8ed-660b32c65a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.815409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 955/1939] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:31.816578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.905494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219400d-e685-43cd-a8ed-660b32c65a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.907833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b757a1-28ec-4245-ad03-f0fdf56c7e64 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.908426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219400d-e685-43cd-a8ed-660b32c65a47 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.913425 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de851-d8fd-4f95-8b59-3d177908c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.915111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de851-d8fd-4f95-8b59-3d177908c0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.915111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de851-d8fd-4f95-8b59-3d177908c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.915399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959de851-d8fd-4f95-8b59-3d177908c0fb admin admin] PATH_INFO: `/v3/projects/a535c1adb4e34098af54dc1582943309/users/11761ab6b7b24ca8a24960e83a5a65e1/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.918805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:31.923969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 985/1940] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:31.925336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219400d-e685-43cd-a8ed-660b32c65a47 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.941974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219400d-e685-43cd-a8ed-660b32c65a47 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:31.945974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de851-d8fd-4f95-8b59-3d177908c0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a535c1adb4e34098af54dc1582943309, user_id=11761ab6b7b24ca8a24960e83a5a65e1, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.950244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223548d3-5aa6-4233-8d66-4db6f873e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:31.951282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959de851-d8fd-4f95-8b59-3d177908c0fb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.951750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223548d3-5aa6-4233-8d66-4db6f873e04a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.952143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223548d3-5aa6-4233-8d66-4db6f873e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.952636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223548d3-5aa6-4233-8d66-4db6f873e04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:31.954070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223548d3-5aa6-4233-8d66-4db6f873e04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:31.957223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223548d3-5aa6-4233-8d66-4db6f873e04a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:31.974961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 956/1941] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:31 2022] PUT /identity/v3/projects/a535c1adb4e34098af54dc1582943309/users/11761ab6b7b24ca8a24960e83a5a65e1/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:31.976771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de851-d8fd-4f95-8b59-3d177908c0fb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:31.984177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 986/1942] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:31.998096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646ccac-c4a8-4cd6-9c3e-31c3d71a00ec None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:31.998336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646ccac-c4a8-4cd6-9c3e-31c3d71a00ec None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:31.998806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646ccac-c4a8-4cd6-9c3e-31c3d71a00ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.057775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6646ccac-c4a8-4cd6-9c3e-31c3d71a00ec None None] MFA Rules not processed for user `11761ab6b7b24ca8a24960e83a5a65e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:32.059624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6646ccac-c4a8-4cd6-9c3e-31c3d71a00ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:32.100585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959de851-d8fd-4f95-8b59-3d177908c0fb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:32.111216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cfd35-4cfc-4206-b906-acd086e5dccd tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3810cd357ac41cd93b1550fb3511eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef2c270af9d745c384b7bb57046a6226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:32.112587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cfd35-4cfc-4206-b906-acd086e5dccd tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:32.113161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cfd35-4cfc-4206-b906-acd086e5dccd tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:32.114063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cfd35-4cfc-4206-b906-acd086e5dccd tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.115398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cfd35-4cfc-4206-b906-acd086e5dccd tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:32.119243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cfd35-4cfc-4206-b906-acd086e5dccd tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:32.184043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 957/1943] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:31 2022] POST /identity/v3/projects => generated 353 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:32.185253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cfd35-4cfc-4206-b906-acd086e5dccd tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:32.200553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 987/1944] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:32.200553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646ccac-c4a8-4cd6-9c3e-31c3d71a00ec None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:32.217414 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646ccac-c4a8-4cd6-9c3e-31c3d71a00ec None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:32.302144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:32.314647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3810cd357ac41cd93b1550fb3511eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef2c270af9d745c384b7bb57046a6226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:32.315810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:32.316879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:32.320317 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cfd35-4cfc-4206-b906-acd086e5dccd tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:32.321400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.322686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:32.323195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:32.325859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:32.342252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 988/1945] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:32.343283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:32.347298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bdf3e-1977-4211-9e00-140d5f5a0bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:32.348728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdf3e-1977-4211-9e00-140d5f5a0bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:32.349081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdf3e-1977-4211-9e00-140d5f5a0bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:32.349950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bdf3e-1977-4211-9e00-140d5f5a0bd6 admin admin] PATH_INFO: `/v3/projects/9810ad72a24e48f098c7f68b6a0ff0ef/users/891ad55303cb46d3ba2afb843070d545/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.354328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bdf3e-1977-4211-9e00-140d5f5a0bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9810ad72a24e48f098c7f68b6a0ff0ef, user_id=891ad55303cb46d3ba2afb843070d545, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:32.358479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ad9fb-8261-44ac-b24b-ba1d4c035b50 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:32.362116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bdf3e-1977-4211-9e00-140d5f5a0bd6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:32.364985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bd01f-9533-49b0-b1ec-ecafaf1d6d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:32.365954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bd01f-9533-49b0-b1ec-ecafaf1d6d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:32.366632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bd01f-9533-49b0-b1ec-ecafaf1d6d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:32.367114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bd01f-9533-49b0-b1ec-ecafaf1d6d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.368137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bd01f-9533-49b0-b1ec-ecafaf1d6d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:32.371292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bd01f-9533-49b0-b1ec-ecafaf1d6d44 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:32.393045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 958/1946] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:32 2022] PUT /identity/v3/projects/9810ad72a24e48f098c7f68b6a0ff0ef/users/891ad55303cb46d3ba2afb843070d545/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:32.404183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9f94-b71d-40ca-9b10-ef138dc45116 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:32.404537 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9f94-b71d-40ca-9b10-ef138dc45116 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:32.405516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9f94-b71d-40ca-9b10-ef138dc45116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.431742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 989/1947] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:32 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:32.439667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bd01f-9533-49b0-b1ec-ecafaf1d6d44 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:32.475122 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-95dd9f94-b71d-40ca-9b10-ef138dc45116 None None] MFA Rules not processed for user `891ad55303cb46d3ba2afb843070d545`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:32.476864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-95dd9f94-b71d-40ca-9b10-ef138dc45116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:32.576299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bd01f-9533-49b0-b1ec-ecafaf1d6d44 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:32.582761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3810cd357ac41cd93b1550fb3511eac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef2c270af9d745c384b7bb57046a6226', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:32.585207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:32.585824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:32.586560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] PATH_INFO: `/v3/projects/3c5dcdb17dbf40b58b568ab145562617` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.589699 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c5dcdb17dbf40b58b568ab145562617)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:32.591766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:32.598378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:32.625056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 959/1948] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:32.633238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9f94-b71d-40ca-9b10-ef138dc45116 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:32.665069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c5dcdb17dbf40b58b568ab145562617', 'request_id': 'req-e2231b99-a70b-4258-9f61-71fd4ea10233'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.674541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c5dcdb17dbf40b58b568ab145562617', 'request_id': 'req-e2231b99-a70b-4258-9f61-71fd4ea10233'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.685417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c5dcdb17dbf40b58b568ab145562617', 'request_id': 'req-e2231b99-a70b-4258-9f61-71fd4ea10233'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.706473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] The token cache is being invalidate because project 3c5dcdb17dbf40b58b568ab145562617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:32.708543 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.714080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.714080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 990/1949] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:32 2022] DELETE /identity/v3/projects/3c5dcdb17dbf40b58b568ab145562617 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:32.714080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:32.716158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:32.749485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd9f94-b71d-40ca-9b10-ef138dc45116 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:32.810640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:32.816047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2231b99-a70b-4258-9f61-71fd4ea10233 tempest-VolumeQuotaClassesTest-1395204929 tempest-VolumeQuotaClassesTest-1395204929-project-admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:32.824530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:32.825734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:32.826281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:32.827743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] PATH_INFO: `/v3/projects/fed3d844e56b415781169b4f87bf1d19` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.829947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed3d844e56b415781169b4f87bf1d19)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:32.832889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:32.837996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:32.838690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:32.838978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:32.839251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:32.839950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:32.842656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:32.871392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 960/1950] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:32 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:32.873528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:32.875585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:32.899023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed3d844e56b415781169b4f87bf1d19', 'request_id': 'req-75bc655a-3288-437c-ac11-c89883143660'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.911138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed3d844e56b415781169b4f87bf1d19', 'request_id': 'req-75bc655a-3288-437c-ac11-c89883143660'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.922812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed3d844e56b415781169b4f87bf1d19', 'request_id': 'req-75bc655a-3288-437c-ac11-c89883143660'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.942166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] The token cache is being invalidate because project fed3d844e56b415781169b4f87bf1d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:32.942606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.943283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:32.945801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 991/1951] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:32 2022] DELETE /identity/v3/projects/fed3d844e56b415781169b4f87bf1d19 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:32.947881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:32.950832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:32.962336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5ed12-5c6f-4b20-b9e0-28a756514602 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.032447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:33.039484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc655a-3288-437c-ac11-c89883143660 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.046729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.047963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.048098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.048508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.048819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.049048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.049225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.049381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.050104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:33.052503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.052887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:33.065153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 992/1952] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:33.066186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:33.068274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.100457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9489f38-a02a-45c6-a61f-c16fc4a943b9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.110937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.112651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.113153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.113488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] PATH_INFO: `/v3/users/79a4dfff63ab4a4485f75ac14b4cae10` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.115452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a4dfff63ab4a4485f75ac14b4cae10)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:33.118214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:33.185225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:33.188152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:33.203829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 961/1953] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:33.204719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:33.205974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.206793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a4dfff63ab4a4485f75ac14b4cae10'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.207559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a4dfff63ab4a4485f75ac14b4cae10'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.217468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a4dfff63ab4a4485f75ac14b4cae10'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.224410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07843be-561c-4ab0-a6ab-2238b3eb5e7f service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.228547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a4dfff63ab4a4485f75ac14b4cae10'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.230187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.230682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a4dfff63ab4a4485f75ac14b4cae10'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.231101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.231388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.231670 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] PATH_INFO: `/v3/users/e38a6a776a474f55a567b0769d46dc4d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.233005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38a6a776a474f55a567b0769d46dc4d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:33.235037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:33.248203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:33.265892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 993/1954] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:33 2022] DELETE /identity/v3/users/79a4dfff63ab4a4485f75ac14b4cae10 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:33.267937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:33.272271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.325758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38a6a776a474f55a567b0769d46dc4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.327617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38a6a776a474f55a567b0769d46dc4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.349456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38a6a776a474f55a567b0769d46dc4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.351331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38a6a776a474f55a567b0769d46dc4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.356722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c8a5d-01f6-4a0c-8c80-6367dcb51049 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.362176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38174f-2e5d-41d7-a1b2-4b381a2d836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.363885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38174f-2e5d-41d7-a1b2-4b381a2d836b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.363885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38174f-2e5d-41d7-a1b2-4b381a2d836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.363885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38174f-2e5d-41d7-a1b2-4b381a2d836b admin admin] PATH_INFO: `/v3/projects/9d01afcb87734921b3c60fe02db29a3c/users/3e02ebe49393417e878f483f2fd88b5f/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.368879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38a6a776a474f55a567b0769d46dc4d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.381630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38174f-2e5d-41d7-a1b2-4b381a2d836b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d01afcb87734921b3c60fe02db29a3c, user_id=3e02ebe49393417e878f483f2fd88b5f, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:33.384665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38174f-2e5d-41d7-a1b2-4b381a2d836b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:33.396883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 962/1955] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:33 2022] DELETE /identity/v3/users/e38a6a776a474f55a567b0769d46dc4d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:33.400656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:33.400656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.405422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 994/1956] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:33 2022] PUT /identity/v3/projects/9d01afcb87734921b3c60fe02db29a3c/users/3e02ebe49393417e878f483f2fd88b5f/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:33.407027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bec9e-4895-45e4-939c-c4b1b3ed99d3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.407470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bec9e-4895-45e4-939c-c4b1b3ed99d3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.407888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bec9e-4895-45e4-939c-c4b1b3ed99d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.432406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fc5bec9e-4895-45e4-939c-c4b1b3ed99d3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:33.433993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fc5bec9e-4895-45e4-939c-c4b1b3ed99d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.559841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 995/1957] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:33.562683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bec9e-4895-45e4-939c-c4b1b3ed99d3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:33.569966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fc5bec9e-4895-45e4-939c-c4b1b3ed99d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.574215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cc175-6adf-454a-8a6b-47a676eca057 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.591118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.593283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.595239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.596292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] PATH_INFO: `/v3/users/b76b5dce34164ffd9f28432b5d41c0dd` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.598903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76b5dce34164ffd9f28432b5d41c0dd)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:33.604780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:33.608352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5bec9e-4895-45e4-939c-c4b1b3ed99d3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.611026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:33.614781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.616296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.616610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.616892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.617719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:33.623437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:33.641039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 996/1958] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:33.641039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:33.641039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.737729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76b5dce34164ffd9f28432b5d41c0dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.738547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76b5dce34164ffd9f28432b5d41c0dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.753645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea006912-d7c1-46a2-9d92-87a61473fcde admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.759956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17247ede-98f3-44e5-b14b-1b43aa0dcc82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.761037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17247ede-98f3-44e5-b14b-1b43aa0dcc82 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.761261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17247ede-98f3-44e5-b14b-1b43aa0dcc82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.761740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17247ede-98f3-44e5-b14b-1b43aa0dcc82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.772989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76b5dce34164ffd9f28432b5d41c0dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.774214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76b5dce34164ffd9f28432b5d41c0dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.785712 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17247ede-98f3-44e5-b14b-1b43aa0dcc82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:33.787822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17247ede-98f3-44e5-b14b-1b43aa0dcc82 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:33.790524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76b5dce34164ffd9f28432b5d41c0dd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:33.809336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 963/1959] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:33 2022] DELETE /identity/v3/users/b76b5dce34164ffd9f28432b5d41c0dd => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:33.813556 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:33.814065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 997/1960] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:33.815379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.816811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42011-c1ca-445a-b8f8-e5e90dfc47c1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.817549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42011-c1ca-445a-b8f8-e5e90dfc47c1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.817912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c42011-c1ca-445a-b8f8-e5e90dfc47c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.845796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-66c42011-c1ca-445a-b8f8-e5e90dfc47c1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:33.852082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-66c42011-c1ca-445a-b8f8-e5e90dfc47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:33.858977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:33.980079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c84316-e9ff-4c8a-b647-f4bb8c8d40ec admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:33.995522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:33.996663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:33.996938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:33.997226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] PATH_INFO: `/v3/projects/9d01afcb87734921b3c60fe02db29a3c/users/3e02ebe49393417e878f483f2fd88b5f/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:33.999440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d01afcb87734921b3c60fe02db29a3c, user_id=3e02ebe49393417e878f483f2fd88b5f, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:34.004772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 998/1961] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:34.005634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:34.005734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c42011-c1ca-445a-b8f8-e5e90dfc47c1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:34.010349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-66c42011-c1ca-445a-b8f8-e5e90dfc47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:34.018443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 964/1962] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:33 2022] PUT /identity/v3/projects/9d01afcb87734921b3c60fe02db29a3c/users/3e02ebe49393417e878f483f2fd88b5f/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:34.019450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:34.021561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:34.042606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c42011-c1ca-445a-b8f8-e5e90dfc47c1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:34.158781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ad105-4531-47e0-be7b-f6225ab39336 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:34.183219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae3d2-788f-45da-aef5-cf18570145ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:34.185494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae3d2-788f-45da-aef5-cf18570145ee service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.192361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae3d2-788f-45da-aef5-cf18570145ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.192697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae3d2-788f-45da-aef5-cf18570145ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.206265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:34.207213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.207497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.207774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] PATH_INFO: `/v3/projects/011e7264d38249ab98401615f93d324b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.209307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] RBAC: Authorizing `identity:delete_project(project_id=011e7264d38249ab98401615f93d324b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:34.213024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:34.255865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:34.295523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011e7264d38249ab98401615f93d324b', 'request_id': 'req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.304044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011e7264d38249ab98401615f93d324b', 'request_id': 'req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.313780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae3d2-788f-45da-aef5-cf18570145ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:34.314925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011e7264d38249ab98401615f93d324b', 'request_id': 'req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.315513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae3d2-788f-45da-aef5-cf18570145ee service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:34.329144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 965/1963] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:34.330795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5231ba-790c-4599-bf6a-62bb5ad7630d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.330795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5231ba-790c-4599-bf6a-62bb5ad7630d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.331171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5231ba-790c-4599-bf6a-62bb5ad7630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.336423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] The token cache is being invalidate because project 011e7264d38249ab98401615f93d324b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:34.336857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.337819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7d6adb3c-3b9b-4f8a-af8f-a6204df5587e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.342164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 999/1964] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:34 2022] DELETE /identity/v3/projects/011e7264d38249ab98401615f93d324b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:34.347612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec759-0586-410a-87e7-6ed29a5c0070 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.347913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec759-0586-410a-87e7-6ed29a5c0070 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.348300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec759-0586-410a-87e7-6ed29a5c0070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.370829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8c5231ba-790c-4599-bf6a-62bb5ad7630d None None] MFA Rules not processed for user `3e02ebe49393417e878f483f2fd88b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:34.373067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8c5231ba-790c-4599-bf6a-62bb5ad7630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:34.380810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-37dec759-0586-410a-87e7-6ed29a5c0070 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:34.382093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-37dec759-0586-410a-87e7-6ed29a5c0070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:34.444346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:34.476485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1000/1965] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:18:34.489773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f9be-5539-4b55-98c9-b059ff09e8a3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.490288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f9be-5539-4b55-98c9-b059ff09e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.490721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4f9be-5539-4b55-98c9-b059ff09e8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.530502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a7a4f9be-5539-4b55-98c9-b059ff09e8a3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:34.532067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a7a4f9be-5539-4b55-98c9-b059ff09e8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:34.535643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 966/1966] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:34.551355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1001/1967] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:18:34.552487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5231ba-790c-4599-bf6a-62bb5ad7630d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:34.558556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4f9be-5539-4b55-98c9-b059ff09e8a3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:34.567749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8c5231ba-790c-4599-bf6a-62bb5ad7630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:34.573413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4f9be-5539-4b55-98c9-b059ff09e8a3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:34.583214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:34.584544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.585170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.585834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.587492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:34.588198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:34.591694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:34.613041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1002/1968] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:18:34.614290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:34.620593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:34.636247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea51a0-50fb-432b-bb4c-c4a8e184ac20 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:34.641730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:34.643364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.643364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.643364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] PATH_INFO: `/v3/projects/f5a472acb7c44871b0b38ecde0fa0ebc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.644653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a472acb7c44871b0b38ecde0fa0ebc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:34.646887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:34.677074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5231ba-790c-4599-bf6a-62bb5ad7630d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:34.683566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf888-a20d-414a-97ab-12c758bf367b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:34.684559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf888-a20d-414a-97ab-12c758bf367b service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.685164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf888-a20d-414a-97ab-12c758bf367b service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.685275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf888-a20d-414a-97ab-12c758bf367b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.701270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf888-a20d-414a-97ab-12c758bf367b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:34.703610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf888-a20d-414a-97ab-12c758bf367b service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:34.711077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a472acb7c44871b0b38ecde0fa0ebc', 'request_id': 'req-ae003b21-04ad-4669-a028-b7d8d254bfcd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.716374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 967/1969] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:18:34.717245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf888-a20d-414a-97ab-12c758bf367b service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:34.723303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a472acb7c44871b0b38ecde0fa0ebc', 'request_id': 'req-ae003b21-04ad-4669-a028-b7d8d254bfcd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.729856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf888-a20d-414a-97ab-12c758bf367b service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:34.736532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a472acb7c44871b0b38ecde0fa0ebc', 'request_id': 'req-ae003b21-04ad-4669-a028-b7d8d254bfcd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.760404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] The token cache is being invalidate because project f5a472acb7c44871b0b38ecde0fa0ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:34.760694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.762680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:34.768441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1003/1970] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:34 2022] DELETE /identity/v3/projects/f5a472acb7c44871b0b38ecde0fa0ebc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:34.769906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:34.772549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:34.847717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:34.860348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:34.861474 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.861904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.862322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.863428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:34.865851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:34.892247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae003b21-04ad-4669-a028-b7d8d254bfcd admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:34.904918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:34.907991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:34.908661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:34.909021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] PATH_INFO: `/v3/users/e3810cd357ac41cd93b1550fb3511eac` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:34.910883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 968/1971] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:34 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:34.916436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:34.916864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3810cd357ac41cd93b1550fb3511eac)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:34.920251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:34.920985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:35.000186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3810cd357ac41cd93b1550fb3511eac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.001177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3810cd357ac41cd93b1550fb3511eac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.002736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:35.013253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3810cd357ac41cd93b1550fb3511eac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.026741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3810cd357ac41cd93b1550fb3511eac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.028805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3810cd357ac41cd93b1550fb3511eac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.042699 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b7121-66c6-4710-9d88-e39c1e8f502b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:35.062219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:35.066300 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:35.070495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:35.070950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:35.072459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1004/1972] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:34 2022] DELETE /identity/v3/users/e3810cd357ac41cd93b1550fb3511eac => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:35.072894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:35.074183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:35.075329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:35.076523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:35.114807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 969/1973] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:34 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:18:35.117671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:35.125159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:35.156532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756be46-b138-419c-af07-091d652e97a2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:35.224571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd8a35-c06c-46b7-8004-c2f6a69aafcd admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:35.229472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:35.230298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:35.230685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:35.231703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:35.233902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:35.254399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:35.255111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:35.255403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:35.255733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:35.256527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:35.258333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:35.275249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 970/1974] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:35.277329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:35.279955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:35.302618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad944bb-1e6d-4724-bbc1-3a1f49761bb9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:35.309714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:35.310384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:35.310667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:35.310940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] PATH_INFO: `/v3/projects/ce1500545c4945049f2811300a1c65c8` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:35.315121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1500545c4945049f2811300a1c65c8)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:35.323789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:35.374064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:35.376938 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:35.389368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1005/1975] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:35.402119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:35.429334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb985e4-9383-4c08-97d2-4f5dc8cc7b50 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:35.457616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1500545c4945049f2811300a1c65c8', 'request_id': 'req-78751ea3-8c5e-426d-8287-097c853c46f6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.475424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1500545c4945049f2811300a1c65c8', 'request_id': 'req-78751ea3-8c5e-426d-8287-097c853c46f6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.481599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:35.499952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1500545c4945049f2811300a1c65c8', 'request_id': 'req-78751ea3-8c5e-426d-8287-097c853c46f6'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.549451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] The token cache is being invalidate because project ce1500545c4945049f2811300a1c65c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:35.550057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.551334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.577561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 971/1976] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:35 2022] DELETE /identity/v3/projects/ce1500545c4945049f2811300a1c65c8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:35.582148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:35.595224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:35.621976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:35.624801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:35.627582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:35.627582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:35.627861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:35.630256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:35.657709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1006/1977] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:35.662723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:35.665867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:35.684996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059be29-7521-47d9-98ae-b0c27107535d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:35.695941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:35.698839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:35.699341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:35.699788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] PATH_INFO: `/v3/users/891ad55303cb46d3ba2afb843070d545` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:35.701500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891ad55303cb46d3ba2afb843070d545)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:35.704970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:35.727598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:35.822472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891ad55303cb46d3ba2afb843070d545'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.823357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891ad55303cb46d3ba2afb843070d545'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.855953 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891ad55303cb46d3ba2afb843070d545'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.869284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891ad55303cb46d3ba2afb843070d545'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.870080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891ad55303cb46d3ba2afb843070d545'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:35.882053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78751ea3-8c5e-426d-8287-097c853c46f6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:35.907351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:35.909779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:35.912202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:35.912202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] PATH_INFO: `/v3/projects/ef2c270af9d745c384b7bb57046a6226` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:35.918106 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1007/1978] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:35 2022] DELETE /identity/v3/users/891ad55303cb46d3ba2afb843070d545 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:35.919076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:35.921940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2c270af9d745c384b7bb57046a6226)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:35.924534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:35.928533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.048325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2c270af9d745c384b7bb57046a6226', 'request_id': 'req-11ec6e26-3936-47e9-82f0-05f375c9d9ca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.082610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2c270af9d745c384b7bb57046a6226', 'request_id': 'req-11ec6e26-3936-47e9-82f0-05f375c9d9ca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.100640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2c270af9d745c384b7bb57046a6226', 'request_id': 'req-11ec6e26-3936-47e9-82f0-05f375c9d9ca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.130918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] The token cache is being invalidate because project ef2c270af9d745c384b7bb57046a6226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:36.137513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.139738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11ec6e26-3936-47e9-82f0-05f375c9d9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.141761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 972/1979] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:35 2022] DELETE /identity/v3/projects/ef2c270af9d745c384b7bb57046a6226 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:36.151356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659498c-de83-4bc8-b245-edf72f1e6030 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.151651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659498c-de83-4bc8-b245-edf72f1e6030 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.152038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659498c-de83-4bc8-b245-edf72f1e6030 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.155166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 973/1980] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:18:36 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:18:36.162834 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57a5d-b790-4cae-8cfa-e66a314444e8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.163107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57a5d-b790-4cae-8cfa-e66a314444e8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.163394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57a5d-b790-4cae-8cfa-e66a314444e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.170479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33292c0b-8c08-46a8-b3ae-5e1619d45515 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:36.239602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f7d57a5d-b790-4cae-8cfa-e66a314444e8 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:36.244673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f7d57a5d-b790-4cae-8cfa-e66a314444e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.346779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fcb24-dbb3-4e28-a2df-1af818974505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:36.350413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 974/1981] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:36.350681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fcb24-dbb3-4e28-a2df-1af818974505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.351455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fcb24-dbb3-4e28-a2df-1af818974505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.352076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fcb24-dbb3-4e28-a2df-1af818974505 admin admin] PATH_INFO: `/v3/projects/d41c5fed94f84e579142476e8294d97e/users/b5769420621c47c3be94a1cb8819828b/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.361550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac6cd-5ebe-4333-9202-054e02cbc428 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.361903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac6cd-5ebe-4333-9202-054e02cbc428 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.362195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac6cd-5ebe-4333-9202-054e02cbc428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.385396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fcb24-dbb3-4e28-a2df-1af818974505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41c5fed94f84e579142476e8294d97e, user_id=b5769420621c47c3be94a1cb8819828b, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:36.389095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cdfac6cd-5ebe-4333-9202-054e02cbc428 None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:36.389448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fcb24-dbb3-4e28-a2df-1af818974505 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:36.391030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cdfac6cd-5ebe-4333-9202-054e02cbc428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.410285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:36.424166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1008/1982] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:35 2022] PUT /identity/v3/projects/d41c5fed94f84e579142476e8294d97e/users/b5769420621c47c3be94a1cb8819828b/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:36.424166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6802a-4cc5-47a6-b96d-49102034f001 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.424166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6802a-4cc5-47a6-b96d-49102034f001 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.424166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6802a-4cc5-47a6-b96d-49102034f001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.451352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-89c6802a-4cc5-47a6-b96d-49102034f001 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:36.455037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-89c6802a-4cc5-47a6-b96d-49102034f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.482571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:36.544297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 975/1983] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:18:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:36.545846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee6b6-a6f4-4a88-87cb-c83921419169 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.547133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee6b6-a6f4-4a88-87cb-c83921419169 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.547923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee6b6-a6f4-4a88-87cb-c83921419169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.568207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1009/1984] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:36.568207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6802a-4cc5-47a6-b96d-49102034f001 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:36.570825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-89c6802a-4cc5-47a6-b96d-49102034f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.582792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b89ee6b6-a6f4-4a88-87cb-c83921419169 None None] MFA Rules not processed for user `b5769420621c47c3be94a1cb8819828b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:36.584035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b89ee6b6-a6f4-4a88-87cb-c83921419169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.675883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6802a-4cc5-47a6-b96d-49102034f001 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:36.676881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 976/1985] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:36.677735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ee6b6-a6f4-4a88-87cb-c83921419169 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:36.686167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:36.687319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.687854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.688230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.689445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ee6b6-a6f4-4a88-87cb-c83921419169 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:36.694380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:36.695812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.696412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.697246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.698007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:36.698315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:36.700072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:36.701317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:36.703279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:36.714345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 977/1986] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:36.715485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1010/1987] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:36.715603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:36.716165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:36.717509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.718035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.732461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c247897-1360-449b-bd6f-4296f26f6d0b service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:36.737956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d817-8e31-4b3a-9020-b9acbaa5afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:36.738633 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d817-8e31-4b3a-9020-b9acbaa5afc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.738916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d817-8e31-4b3a-9020-b9acbaa5afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.739193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d817-8e31-4b3a-9020-b9acbaa5afc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.739897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d817-8e31-4b3a-9020-b9acbaa5afc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:36.742341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d817-8e31-4b3a-9020-b9acbaa5afc2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:36.744451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917e28a-c1d9-432d-8896-c490646981e1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:36.752319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:36.753899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.754403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.754872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] PATH_INFO: `/v3/projects/9810ad72a24e48f098c7f68b6a0ff0ef` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.757220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9810ad72a24e48f098c7f68b6a0ff0ef)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:36.760346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:36.773756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1011/1988] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:36 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:36.774602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d817-8e31-4b3a-9020-b9acbaa5afc2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:36.838842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9810ad72a24e48f098c7f68b6a0ff0ef', 'request_id': 'req-f003916c-28ce-4547-b898-4ecf3807a03f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.850482 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9810ad72a24e48f098c7f68b6a0ff0ef', 'request_id': 'req-f003916c-28ce-4547-b898-4ecf3807a03f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.862612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9810ad72a24e48f098c7f68b6a0ff0ef', 'request_id': 'req-f003916c-28ce-4547-b898-4ecf3807a03f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.876398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d817-8e31-4b3a-9020-b9acbaa5afc2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:36.877557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] The token cache is being invalidate because project 9810ad72a24e48f098c7f68b6a0ff0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:36.877828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.878515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:36.880130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 978/1989] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:36 2022] DELETE /identity/v3/projects/9810ad72a24e48f098c7f68b6a0ff0ef => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:36.880903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:36.882605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:36.904690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:36.924061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:36.964400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e389e-09f1-4181-a52c-1ef9b14a34dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:36.965285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e389e-09f1-4181-a52c-1ef9b14a34dc admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:36.965685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e389e-09f1-4181-a52c-1ef9b14a34dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:36.966028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e389e-09f1-4181-a52c-1ef9b14a34dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:36.967005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e389e-09f1-4181-a52c-1ef9b14a34dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:36.969848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e389e-09f1-4181-a52c-1ef9b14a34dc admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:36.997982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003916c-28ce-4547-b898-4ecf3807a03f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.003666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.004797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.005166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.005605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.006517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.012225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1012/1990] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:36 2022] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:37.012410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.012494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbfb4-bc08-4d19-ac6a-3702d1cf22d7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.012494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbfb4-bc08-4d19-ac6a-3702d1cf22d7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.012897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbfb4-bc08-4d19-ac6a-3702d1cf22d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.036639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 979/1991] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:36 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:37.036639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.036639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:37.037233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f49bbfb4-bc08-4d19-ac6a-3702d1cf22d7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:37.038448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f49bbfb4-bc08-4d19-ac6a-3702d1cf22d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:37.049838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6936-0844-4951-bced-5ca886ccee01 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.111309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1013/1992] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:37.116939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63467ee6-fc4f-4e4b-bbce-e107fdbab02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.117730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63467ee6-fc4f-4e4b-bbce-e107fdbab02f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.118250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63467ee6-fc4f-4e4b-bbce-e107fdbab02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.118907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63467ee6-fc4f-4e4b-bbce-e107fdbab02f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.119914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63467ee6-fc4f-4e4b-bbce-e107fdbab02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.122018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbfb4-bc08-4d19-ac6a-3702d1cf22d7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.122126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63467ee6-fc4f-4e4b-bbce-e107fdbab02f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.141465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbfb4-bc08-4d19-ac6a-3702d1cf22d7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.150669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5419-cdfd-4728-9f35-054cc9ef6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.151538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5419-cdfd-4728-9f35-054cc9ef6594 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.151989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5419-cdfd-4728-9f35-054cc9ef6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.152455 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5419-cdfd-4728-9f35-054cc9ef6594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.153380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d5419-cdfd-4728-9f35-054cc9ef6594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.155265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d5419-cdfd-4728-9f35-054cc9ef6594 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.156074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 980/1993] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:37 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:37.157517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ae66-8527-47f6-b1cb-ae54800137a3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.157822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ae66-8527-47f6-b1cb-ae54800137a3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.158120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ae66-8527-47f6-b1cb-ae54800137a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.181986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1014/1994] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:37.182888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5419-cdfd-4728-9f35-054cc9ef6594 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.184764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6ec8ae66-8527-47f6-b1cb-ae54800137a3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:37.186157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6ec8ae66-8527-47f6-b1cb-ae54800137a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:37.195379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 981/1995] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:37.196490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8ae66-8527-47f6-b1cb-ae54800137a3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.204891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5419-cdfd-4728-9f35-054cc9ef6594 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.211033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed290b1-1af9-43b1-90e0-fde66909f985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.211965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed290b1-1af9-43b1-90e0-fde66909f985 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.212955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed290b1-1af9-43b1-90e0-fde66909f985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.213233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed290b1-1af9-43b1-90e0-fde66909f985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.214173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed290b1-1af9-43b1-90e0-fde66909f985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.216020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed290b1-1af9-43b1-90e0-fde66909f985 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.230981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8ae66-8527-47f6-b1cb-ae54800137a3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.235552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1015/1996] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:37.237674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed290b1-1af9-43b1-90e0-fde66909f985 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.244002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15eee-df1d-4ea3-80ef-fb7b7133a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.245069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15eee-df1d-4ea3-80ef-fb7b7133a53e admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.245489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15eee-df1d-4ea3-80ef-fb7b7133a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.245709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb15eee-df1d-4ea3-80ef-fb7b7133a53e admin admin] PATH_INFO: `/v3/projects/c60127c1ca334583a6707e6d791f3131/users/67f275a7bb9348eb8db958a468b72007/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.253295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed290b1-1af9-43b1-90e0-fde66909f985 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.261313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.262159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.262648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.262993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.263839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:37.264262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.266333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.293635 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb15eee-df1d-4ea3-80ef-fb7b7133a53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60127c1ca334583a6707e6d791f3131, user_id=67f275a7bb9348eb8db958a468b72007, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.295925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1016/1997] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:37.296861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.298175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb15eee-df1d-4ea3-80ef-fb7b7133a53e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.311829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9388ecb-0e0d-4cd6-95b7-31fc8aa87bd6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.327998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 982/1998] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:37 2022] PUT /identity/v3/projects/c60127c1ca334583a6707e6d791f3131/users/67f275a7bb9348eb8db958a468b72007/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:37.331930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7f347-fd8d-4625-bada-87d78789b64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.332999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7f347-fd8d-4625-bada-87d78789b64e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.333358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15eee-df1d-4ea3-80ef-fb7b7133a53e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.335934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7f347-fd8d-4625-bada-87d78789b64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.336572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7f347-fd8d-4625-bada-87d78789b64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.338317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7f347-fd8d-4625-bada-87d78789b64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.343657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7f347-fd8d-4625-bada-87d78789b64e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.367370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1017/1999] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:37.367370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7f347-fd8d-4625-bada-87d78789b64e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.392327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7f347-fd8d-4625-bada-87d78789b64e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.489584 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:37.502858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb15eee-df1d-4ea3-80ef-fb7b7133a53e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.532986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ceca-6dab-40ef-a5ce-abd1e588dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.533664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ceca-6dab-40ef-a5ce-abd1e588dba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.533952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ceca-6dab-40ef-a5ce-abd1e588dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.534231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3ceca-6dab-40ef-a5ce-abd1e588dba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.534944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ceca-6dab-40ef-a5ce-abd1e588dba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.536932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3ceca-6dab-40ef-a5ce-abd1e588dba1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.594590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ee7cc-0e21-48bc-bdda-beb107ee0509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.598669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ee7cc-0e21-48bc-bdda-beb107ee0509 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.599014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ee7cc-0e21-48bc-bdda-beb107ee0509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.599309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ee7cc-0e21-48bc-bdda-beb107ee0509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.600092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ee7cc-0e21-48bc-bdda-beb107ee0509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.606269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ee7cc-0e21-48bc-bdda-beb107ee0509 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.613173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 983/2000] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:37 2022] POST /identity/v3/projects => generated 389 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:37.614026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ceca-6dab-40ef-a5ce-abd1e588dba1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.637886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1018/2001] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:37.639001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ee7cc-0e21-48bc-bdda-beb107ee0509 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.649523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:37.661148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ee7cc-0e21-48bc-bdda-beb107ee0509 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.824362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3ceca-6dab-40ef-a5ce-abd1e588dba1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:37.838402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab98e5-54b4-44a6-811a-e8621a73b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.839352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab98e5-54b4-44a6-811a-e8621a73b66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.839622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab98e5-54b4-44a6-811a-e8621a73b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.839904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab98e5-54b4-44a6-811a-e8621a73b66a admin admin] PATH_INFO: `/v3/projects/c1c10d4da0564fc7b15fb786fff67e0d/users/2fc144849976489f8eba0a9dc40c195c/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.865222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64d9c5-ded6-4420-88a3-c7dbd0d2aab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:37.867073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d9c5-ded6-4420-88a3-c7dbd0d2aab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:37.867539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d9c5-ded6-4420-88a3-c7dbd0d2aab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:37.868096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64d9c5-ded6-4420-88a3-c7dbd0d2aab1 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:37.869875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64d9c5-ded6-4420-88a3-c7dbd0d2aab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.874099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64d9c5-ded6-4420-88a3-c7dbd0d2aab1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.880765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab98e5-54b4-44a6-811a-e8621a73b66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c10d4da0564fc7b15fb786fff67e0d, user_id=2fc144849976489f8eba0a9dc40c195c, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:37.893202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab98e5-54b4-44a6-811a-e8621a73b66a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:37.906512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1019/2002] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:37 2022] POST /identity/v3/users => generated 295 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:37.908796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64d9c5-ded6-4420-88a3-c7dbd0d2aab1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.919089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 984/2003] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:37 2022] PUT /identity/v3/projects/c1c10d4da0564fc7b15fb786fff67e0d/users/2fc144849976489f8eba0a9dc40c195c/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:37.931637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab98e5-54b4-44a6-811a-e8621a73b66a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:37.941261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64d9c5-ded6-4420-88a3-c7dbd0d2aab1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.079857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569dc9-14a0-4efa-ac2b-2c503a25063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.085241 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab98e5-54b4-44a6-811a-e8621a73b66a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.086355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569dc9-14a0-4efa-ac2b-2c503a25063f admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.086984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569dc9-14a0-4efa-ac2b-2c503a25063f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.088175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569dc9-14a0-4efa-ac2b-2c503a25063f admin admin] PATH_INFO: `/v3/projects/c60127c1ca334583a6707e6d791f3131/users/67f275a7bb9348eb8db958a468b72007/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.094392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569dc9-14a0-4efa-ac2b-2c503a25063f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60127c1ca334583a6707e6d791f3131, user_id=67f275a7bb9348eb8db958a468b72007, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.100217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2569dc9-14a0-4efa-ac2b-2c503a25063f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.101144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0d0d7-0cfa-4892-b6a4-e1c5a702abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.101935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0d0d7-0cfa-4892-b6a4-e1c5a702abd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.102314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0d0d7-0cfa-4892-b6a4-e1c5a702abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.102836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0d0d7-0cfa-4892-b6a4-e1c5a702abd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.103660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0d0d7-0cfa-4892-b6a4-e1c5a702abd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.107335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0d0d7-0cfa-4892-b6a4-e1c5a702abd8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.122352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1020/2004] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:37 2022] PUT /identity/v3/projects/c60127c1ca334583a6707e6d791f3131/users/67f275a7bb9348eb8db958a468b72007/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:38.123890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321acfe-866d-48b2-944c-4f4dfcfb3ce7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.124320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321acfe-866d-48b2-944c-4f4dfcfb3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.124661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321acfe-866d-48b2-944c-4f4dfcfb3ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.142076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 985/2005] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:38.142076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757bdfc-0224-4291-9f56-da73bf6903dd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.142076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757bdfc-0224-4291-9f56-da73bf6903dd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.142076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757bdfc-0224-4291-9f56-da73bf6903dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.174534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e757bdfc-0224-4291-9f56-da73bf6903dd None None] MFA Rules not processed for user `67f275a7bb9348eb8db958a468b72007`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:38.176171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e757bdfc-0224-4291-9f56-da73bf6903dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:38.180385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5321acfe-866d-48b2-944c-4f4dfcfb3ce7 None None] MFA Rules not processed for user `2fc144849976489f8eba0a9dc40c195c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:38.182317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5321acfe-866d-48b2-944c-4f4dfcfb3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:38.267850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:38.331994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 986/2006] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:38.332947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757bdfc-0224-4291-9f56-da73bf6903dd None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:38.357237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1021/2007] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:38.358752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321acfe-866d-48b2-944c-4f4dfcfb3ce7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:38.360204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5321acfe-866d-48b2-944c-4f4dfcfb3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:38.388559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:38.459092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321acfe-866d-48b2-944c-4f4dfcfb3ce7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.464558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15515-9a54-46ee-be81-ca8dd772b8bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.465434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15515-9a54-46ee-be81-ca8dd772b8bb service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.465727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15515-9a54-46ee-be81-ca8dd772b8bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.466004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15515-9a54-46ee-be81-ca8dd772b8bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.479533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15515-9a54-46ee-be81-ca8dd772b8bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.479844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757bdfc-0224-4291-9f56-da73bf6903dd None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.481291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15515-9a54-46ee-be81-ca8dd772b8bb service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.484676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5abf9-b882-42aa-9975-3bedb1e7b26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.485379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5abf9-b882-42aa-9975-3bedb1e7b26a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.485698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5abf9-b882-42aa-9975-3bedb1e7b26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.486083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5abf9-b882-42aa-9975-3bedb1e7b26a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.486843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5abf9-b882-42aa-9975-3bedb1e7b26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.488627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5abf9-b882-42aa-9975-3bedb1e7b26a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.494337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1022/2008] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:38.495781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15515-9a54-46ee-be81-ca8dd772b8bb service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:38.500545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 987/2009] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:38.504870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5abf9-b882-42aa-9975-3bedb1e7b26a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:38.511275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15515-9a54-46ee-be81-ca8dd772b8bb service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.518478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.519231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.519523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.519803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.520584 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.522741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.538022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5abf9-b882-42aa-9975-3bedb1e7b26a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.549421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af389136-e08f-40a7-b2d6-77879b6dfee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.550758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af389136-e08f-40a7-b2d6-77879b6dfee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.554412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af389136-e08f-40a7-b2d6-77879b6dfee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.554887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af389136-e08f-40a7-b2d6-77879b6dfee6 admin admin] PATH_INFO: `/v3/projects/06fa886fa6e548f191c249169c249500/users/966ee0a48096481f8b849a3dcfc03964/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.582432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af389136-e08f-40a7-b2d6-77879b6dfee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fa886fa6e548f191c249169c249500, user_id=966ee0a48096481f8b849a3dcfc03964, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.585741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af389136-e08f-40a7-b2d6-77879b6dfee6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.588501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1023/2010] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:38 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:38.590396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:38.594707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:38.610771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 988/2011] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:38 2022] PUT /identity/v3/projects/06fa886fa6e548f191c249169c249500/users/966ee0a48096481f8b849a3dcfc03964/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:38.610771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af389136-e08f-40a7-b2d6-77879b6dfee6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:38.690777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af389136-e08f-40a7-b2d6-77879b6dfee6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.691970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edadde-86cc-4545-9200-ed1ad49f785b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.697276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bc407-908b-4979-8f78-4852947ba34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.697510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.698035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc407-908b-4979-8f78-4852947ba34f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.698367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc407-908b-4979-8f78-4852947ba34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.698507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.698640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bc407-908b-4979-8f78-4852947ba34f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.698794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.699114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] PATH_INFO: `/v3/users/feb8033920564e3891698165418e4112` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.699442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bc407-908b-4979-8f78-4852947ba34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.701570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb8033920564e3891698165418e4112)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.702036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936bc407-908b-4979-8f78-4852947ba34f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.704057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.730184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 989/2012] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:38 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:38.731785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47eb6-e8d8-4874-ad7d-5e903cf43a97 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.732218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47eb6-e8d8-4874-ad7d-5e903cf43a97 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.732628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a47eb6-e8d8-4874-ad7d-5e903cf43a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.764749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-42a47eb6-e8d8-4874-ad7d-5e903cf43a97 None None] MFA Rules not processed for user `966ee0a48096481f8b849a3dcfc03964`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:38.766041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-42a47eb6-e8d8-4874-ad7d-5e903cf43a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:38.772849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb8033920564e3891698165418e4112'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:38.773541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb8033920564e3891698165418e4112'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:38.782046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb8033920564e3891698165418e4112'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:38.790663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb8033920564e3891698165418e4112'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:38.791608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb8033920564e3891698165418e4112'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:38.811926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:38.820836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1024/2013] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:38 2022] DELETE /identity/v3/users/feb8033920564e3891698165418e4112 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:38.822773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:38.824436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:38.850852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:38.856555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 990/2014] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:38.859168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47eb6-e8d8-4874-ad7d-5e903cf43a97 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:38.865283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-42a47eb6-e8d8-4874-ad7d-5e903cf43a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:38.890886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a47eb6-e8d8-4874-ad7d-5e903cf43a97 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.912454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffc3459-49d8-4efe-8616-b7127d6570e3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:38.918638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.919421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.919708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.919982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.922290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:38.974434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c93879-0116-4a12-aa92-36488313280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:38.975126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c93879-0116-4a12-aa92-36488313280b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.975417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c93879-0116-4a12-aa92-36488313280b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.975696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c93879-0116-4a12-aa92-36488313280b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.976481 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c93879-0116-4a12-aa92-36488313280b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:38.978733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c93879-0116-4a12-aa92-36488313280b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:38.990027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 991/2015] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:38.995535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9928-26a6-4064-8546-d72a3bcfa7a4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:38.995822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9928-26a6-4064-8546-d72a3bcfa7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:38.996202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd9928-26a6-4064-8546-d72a3bcfa7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:38.998661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.000290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.011980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1025/2016] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:39.018250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-88dd9928-26a6-4064-8546-d72a3bcfa7a4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:39.019473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-88dd9928-26a6-4064-8546-d72a3bcfa7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.025502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.027091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.040658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 992/2017] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:39.041507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9928-26a6-4064-8546-d72a3bcfa7a4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.046257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-88dd9928-26a6-4064-8546-d72a3bcfa7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.056921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4d68b-ec7b-4f67-b3c3-3a7c9e31b835 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.069047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd9928-26a6-4064-8546-d72a3bcfa7a4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.070256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0187b9-ef1e-4b24-b42d-ebe631e206ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.070951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0187b9-ef1e-4b24-b42d-ebe631e206ed admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.071232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0187b9-ef1e-4b24-b42d-ebe631e206ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.072096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0187b9-ef1e-4b24-b42d-ebe631e206ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.072846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0187b9-ef1e-4b24-b42d-ebe631e206ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.074855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0187b9-ef1e-4b24-b42d-ebe631e206ed admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.082894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.083786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.084147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.084417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] PATH_INFO: `/v3/users/11761ab6b7b24ca8a24960e83a5a65e1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.085696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=11761ab6b7b24ca8a24960e83a5a65e1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.088775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.115145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1026/2018] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:39 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:39.118972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0187b9-ef1e-4b24-b42d-ebe631e206ed admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.172504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11761ab6b7b24ca8a24960e83a5a65e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.174365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11761ab6b7b24ca8a24960e83a5a65e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.206906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11761ab6b7b24ca8a24960e83a5a65e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.208365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11761ab6b7b24ca8a24960e83a5a65e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.216041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0187b9-ef1e-4b24-b42d-ebe631e206ed admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.222591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.223657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11761ab6b7b24ca8a24960e83a5a65e1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.223952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.223952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.224464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] PATH_INFO: `/v3/projects/2d0a2dc619e441beba6ad571bb73d0f0/users/3eb87863551b486697ad82ef171dfe5d/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.244709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 993/2019] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:39 2022] DELETE /identity/v3/users/11761ab6b7b24ca8a24960e83a5a65e1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:39.247069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0a2dc619e441beba6ad571bb73d0f0, user_id=3eb87863551b486697ad82ef171dfe5d, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.248651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.250202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.252319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.279666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1027/2020] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:39 2022] PUT /identity/v3/projects/2d0a2dc619e441beba6ad571bb73d0f0/users/3eb87863551b486697ad82ef171dfe5d/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:39.280565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.285469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.310308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:39.338339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:39.342471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83385fd-20b4-40f6-a78e-de1f8f4e8c8b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.408401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7c402-d389-4b24-85b7-6fdb9f85a54d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.416612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c688f7a-c501-4511-8475-18d8555b28df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.417852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c688f7a-c501-4511-8475-18d8555b28df admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.418464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c688f7a-c501-4511-8475-18d8555b28df admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.418606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c688f7a-c501-4511-8475-18d8555b28df admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.419347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c688f7a-c501-4511-8475-18d8555b28df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.422036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c688f7a-c501-4511-8475-18d8555b28df admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.464617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1028/2021] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:39 2022] POST /identity/v3/users => generated 303 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:39.466581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa1c97-b6f6-4fac-a653-8fd28b40652f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.467068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa1c97-b6f6-4fac-a653-8fd28b40652f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.467502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa1c97-b6f6-4fac-a653-8fd28b40652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.475189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.475878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.477092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.477379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.480350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.500334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.502268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.511698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-efaa1c97-b6f6-4fac-a653-8fd28b40652f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:39.517296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 994/2022] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:39.517490 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-efaa1c97-b6f6-4fac-a653-8fd28b40652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.520821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.522615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.540163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1029/2023] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:39.544687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa1c97-b6f6-4fac-a653-8fd28b40652f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.547930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149241a2-7dd4-40a9-80d6-e49aeff21bb7 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.549044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-efaa1c97-b6f6-4fac-a653-8fd28b40652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.553422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5367da-28b2-412d-8055-2e9ba4272240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.554106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5367da-28b2-412d-8055-2e9ba4272240 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.554469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5367da-28b2-412d-8055-2e9ba4272240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.554823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5367da-28b2-412d-8055-2e9ba4272240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.555650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5367da-28b2-412d-8055-2e9ba4272240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.558735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5367da-28b2-412d-8055-2e9ba4272240 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.575252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 995/2024] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:39.575252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5367da-28b2-412d-8055-2e9ba4272240 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.576345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa1c97-b6f6-4fac-a653-8fd28b40652f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.591206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5367da-28b2-412d-8055-2e9ba4272240 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.593073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.594005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.594291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.594568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] PATH_INFO: `/v3/users/b5769420621c47c3be94a1cb8819828b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.597645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.598313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5769420621c47c3be94a1cb8819828b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.598571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.598958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.599357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.600379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.603276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.603682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.619608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 996/2025] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:39.620678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.625094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.648506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c384f-549e-4961-9601-41dd5c541951 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.655094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b851c5-4982-4899-9e55-8b480023fe34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.656519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b851c5-4982-4899-9e55-8b480023fe34 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.657019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b851c5-4982-4899-9e55-8b480023fe34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.657409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b851c5-4982-4899-9e55-8b480023fe34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.684896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b851c5-4982-4899-9e55-8b480023fe34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.687390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b851c5-4982-4899-9e55-8b480023fe34 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.703873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 997/2026] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:39.704983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b851c5-4982-4899-9e55-8b480023fe34 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.715967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5769420621c47c3be94a1cb8819828b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.717148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5769420621c47c3be94a1cb8819828b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.719980 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b851c5-4982-4899-9e55-8b480023fe34 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:39.726421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:39.727458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.728712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.729009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] PATH_INFO: `/v3/projects/2d0a2dc619e441beba6ad571bb73d0f0/users/3eb87863551b486697ad82ef171dfe5d/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.731500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0a2dc619e441beba6ad571bb73d0f0, user_id=3eb87863551b486697ad82ef171dfe5d, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:39.735620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:39.749641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5769420621c47c3be94a1cb8819828b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.753318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 998/2027] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:39 2022] PUT /identity/v3/projects/2d0a2dc619e441beba6ad571bb73d0f0/users/3eb87863551b486697ad82ef171dfe5d/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:39.754842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:39.757642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.767806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5769420621c47c3be94a1cb8819828b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.768775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d476f007-5b67-4f39-942f-70adf7f14111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5769420621c47c3be94a1cb8819828b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:39.824882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1030/2028] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:39 2022] DELETE /identity/v3/users/b5769420621c47c3be94a1cb8819828b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:39.827584 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2a1b6-3df7-4290-a009-ffcc459635dc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:39.828131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2a1b6-3df7-4290-a009-ffcc459635dc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:39.832081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2a1b6-3df7-4290-a009-ffcc459635dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:39.917517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-96a2a1b6-3df7-4290-a009-ffcc459635dc None None] MFA Rules not processed for user `3eb87863551b486697ad82ef171dfe5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:39.919615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-96a2a1b6-3df7-4290-a009-ffcc459635dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:39.965141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858b258-c99d-48d2-b7ce-9dceff72ed68 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:40.093241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1031/2029] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:40.098044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120745-0224-49ac-8e90-c24531dd1eae None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:40.100732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120745-0224-49ac-8e90-c24531dd1eae None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:40.103560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74120745-0224-49ac-8e90-c24531dd1eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:40.130572 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:40.160003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-74120745-0224-49ac-8e90-c24531dd1eae None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:40.160498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:40.162218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-74120745-0224-49ac-8e90-c24531dd1eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:40.162957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:40.163752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:40.166009 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] PATH_INFO: `/v3/projects/73e1019bb2b34751afe04cafa9939630/users/9656946853e54fafabc68cc40d252992/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:40.183440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1032/2030] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:40.184357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74120745-0224-49ac-8e90-c24531dd1eae None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:40.189765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-74120745-0224-49ac-8e90-c24531dd1eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:40.220869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e1019bb2b34751afe04cafa9939630, user_id=9656946853e54fafabc68cc40d252992, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:40.222073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:40.230536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:40.265544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 999/2031] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:39 2022] PUT /identity/v3/projects/73e1019bb2b34751afe04cafa9939630/users/9656946853e54fafabc68cc40d252992/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:40.268022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:40.270693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:40.366985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74120745-0224-49ac-8e90-c24531dd1eae None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:40.391953 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e21eb-c0cd-4d13-a6bb-6713db1a723c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:40.396008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1fb0e-56e9-4d36-a246-3407a9121eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:40.396716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fb0e-56e9-4d36-a246-3407a9121eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:40.396999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fb0e-56e9-4d36-a246-3407a9121eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:40.397275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1fb0e-56e9-4d36-a246-3407a9121eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:40.446065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:40.447807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:40.448209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:40.448554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:40.525759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1fb0e-56e9-4d36-a246-3407a9121eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:40.528846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1fb0e-56e9-4d36-a246-3407a9121eb7 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:40.551170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1000/2032] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:40.552715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1fb0e-56e9-4d36-a246-3407a9121eb7 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:40.567131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:40.568688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:40.573055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1fb0e-56e9-4d36-a246-3407a9121eb7 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:40.582518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acdc42-a537-4248-a55c-7d329cbf5d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:40.583686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acdc42-a537-4248-a55c-7d329cbf5d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:40.584233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acdc42-a537-4248-a55c-7d329cbf5d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:40.584588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1033/2033] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:40.584780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acdc42-a537-4248-a55c-7d329cbf5d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:40.586087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acdc42-a537-4248-a55c-7d329cbf5d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:40.586943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:40.589502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acdc42-a537-4248-a55c-7d329cbf5d8a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:40.590749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:40.623596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1001/2034] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:40.623596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acdc42-a537-4248-a55c-7d329cbf5d8a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:40.644323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef895d6d-7c1d-49ec-875f-5988ff504ef1 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:40.654357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acdc42-a537-4248-a55c-7d329cbf5d8a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:40.662225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1fade7-ea80-417e-931b-8b4ac7f17f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:40.663463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fade7-ea80-417e-931b-8b4ac7f17f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:40.663991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fade7-ea80-417e-931b-8b4ac7f17f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:40.664413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1fade7-ea80-417e-931b-8b4ac7f17f70 admin admin] PATH_INFO: `/v3/projects/73e1019bb2b34751afe04cafa9939630/users/9656946853e54fafabc68cc40d252992/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:40.668084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fade7-ea80-417e-931b-8b4ac7f17f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e1019bb2b34751afe04cafa9939630, user_id=9656946853e54fafabc68cc40d252992, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:40.672186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1fade7-ea80-417e-931b-8b4ac7f17f70 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:40.681596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:40.682845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:40.682845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:40.683081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] PATH_INFO: `/v3/projects/a535c1adb4e34098af54dc1582943309` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:40.689025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a535c1adb4e34098af54dc1582943309)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:40.691039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:40.718630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1002/2035] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:40 2022] PUT /identity/v3/projects/73e1019bb2b34751afe04cafa9939630/users/9656946853e54fafabc68cc40d252992/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:40.720278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237e55-6607-45a9-9182-6d18ab3e3572 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:40.720578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237e55-6607-45a9-9182-6d18ab3e3572 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:40.720862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237e55-6607-45a9-9182-6d18ab3e3572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:40.791177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-06237e55-6607-45a9-9182-6d18ab3e3572 None None] MFA Rules not processed for user `9656946853e54fafabc68cc40d252992`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:40.793582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06237e55-6607-45a9-9182-6d18ab3e3572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:40.834261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a535c1adb4e34098af54dc1582943309', 'request_id': 'req-6d59c466-1ec6-4333-9945-5feb722a7237'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:40.841333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a535c1adb4e34098af54dc1582943309', 'request_id': 'req-6d59c466-1ec6-4333-9945-5feb722a7237'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:40.853709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a535c1adb4e34098af54dc1582943309', 'request_id': 'req-6d59c466-1ec6-4333-9945-5feb722a7237'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:40.867291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:40.897603 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] The token cache is being invalidate because project a535c1adb4e34098af54dc1582943309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:40.899910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:40.902515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:40.910682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1034/2036] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:40 2022] DELETE /identity/v3/projects/a535c1adb4e34098af54dc1582943309 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:40.916700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:40.921266 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:40.961777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:41.017733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1003/2037] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:41.022053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237e55-6607-45a9-9182-6d18ab3e3572 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:41.025073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06237e55-6607-45a9-9182-6d18ab3e3572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:41.148216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59c466-1ec6-4333-9945-5feb722a7237 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:41.173113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:41.174917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:41.175325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:41.176140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] PATH_INFO: `/v3/users/3e02ebe49393417e878f483f2fd88b5f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:41.184614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e02ebe49393417e878f483f2fd88b5f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:41.188387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:41.214537 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237e55-6607-45a9-9182-6d18ab3e3572 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:41.234548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:41.235874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:41.237541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:41.238040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] PATH_INFO: `/v3/projects/f7310799f5b84cb489922271c0fea606` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:41.239999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7310799f5b84cb489922271c0fea606)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:41.244880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:41.303157 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e02ebe49393417e878f483f2fd88b5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.304481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e02ebe49393417e878f483f2fd88b5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.323203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e02ebe49393417e878f483f2fd88b5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.343858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e02ebe49393417e878f483f2fd88b5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.344240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e02ebe49393417e878f483f2fd88b5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.379973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7310799f5b84cb489922271c0fea606', 'request_id': 'req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.384512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1035/2038] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:40 2022] DELETE /identity/v3/users/3e02ebe49393417e878f483f2fd88b5f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:41.385838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:41.387714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7310799f5b84cb489922271c0fea606', 'request_id': 'req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.388019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:41.396743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7310799f5b84cb489922271c0fea606', 'request_id': 'req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.412592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] The token cache is being invalidate because project f7310799f5b84cb489922271c0fea606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:41.412872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.413658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.420463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1004/2039] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:41 2022] DELETE /identity/v3/projects/f7310799f5b84cb489922271c0fea606 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:41.420463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:41.420463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:41.490840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695238-d438-46df-9055-484b527dd8dd admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:41.497142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:41.498108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:41.498409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:41.498691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:41.501401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:41.542316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b385b-3d4b-4550-89d6-e0b29e8f5c21 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:41.561436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:41.597047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:41.651460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:41.656246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:41.686500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1036/2040] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:41.687665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:41.689289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:41.737909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:41.739152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:41.739641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:41.740066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] PATH_INFO: `/v3/projects/d41c5fed94f84e579142476e8294d97e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:41.745661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41c5fed94f84e579142476e8294d97e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:41.753398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:41.786596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee5762-2b87-4bc5-8a99-7e42288bb606 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:41.796346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:41.797396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:41.797723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:41.797941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] PATH_INFO: `/v3/users/2fc144849976489f8eba0a9dc40c195c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:41.801214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc144849976489f8eba0a9dc40c195c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:41.803427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:41.857580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41c5fed94f84e579142476e8294d97e', 'request_id': 'req-9c6218c6-a09a-4682-8a2c-746d379f6f81'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.865705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41c5fed94f84e579142476e8294d97e', 'request_id': 'req-9c6218c6-a09a-4682-8a2c-746d379f6f81'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.875944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41c5fed94f84e579142476e8294d97e', 'request_id': 'req-9c6218c6-a09a-4682-8a2c-746d379f6f81'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.885279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc144849976489f8eba0a9dc40c195c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.885986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc144849976489f8eba0a9dc40c195c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.892138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] The token cache is being invalidate because project d41c5fed94f84e579142476e8294d97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:41.892572 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.893277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.895213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1005/2041] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:41 2022] DELETE /identity/v3/projects/d41c5fed94f84e579142476e8294d97e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:41.896137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:41.897590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:41.902119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc144849976489f8eba0a9dc40c195c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.914064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc144849976489f8eba0a9dc40c195c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.914966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc144849976489f8eba0a9dc40c195c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:41.949663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1037/2042] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:41 2022] DELETE /identity/v3/users/2fc144849976489f8eba0a9dc40c195c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:41.950771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:41.953146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:42.019111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6218c6-a09a-4682-8a2c-746d379f6f81 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:42.044018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:42.062923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbd4c0-bc1d-45a5-bc4f-22efea0e87c5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:42.067925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:42.068581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:42.068869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:42.069426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:42.071336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:42.133082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:42.134804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:42.135168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:42.135522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] PATH_INFO: `/v3/users/c67624d15720443486d6195a119c3ca1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:42.137793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67624d15720443486d6195a119c3ca1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:42.139806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:42.151543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:42.162442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:42.164074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:42.188497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1038/2043] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:42.190502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:42.195020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:42.254082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67624d15720443486d6195a119c3ca1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.254900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67624d15720443486d6195a119c3ca1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.255009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26c615-f30f-4646-96dc-cfc8a0712731 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:42.266829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:42.268840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:42.269132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:42.269724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] PATH_INFO: `/v3/users/67f275a7bb9348eb8db958a468b72007` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:42.271766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f275a7bb9348eb8db958a468b72007)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:42.276024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:42.286575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67624d15720443486d6195a119c3ca1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.288384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67624d15720443486d6195a119c3ca1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.306727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9cb4c02b-eea9-4a98-b2e7-c3ed907a38ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67624d15720443486d6195a119c3ca1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.336153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1006/2044] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:41 2022] DELETE /identity/v3/users/c67624d15720443486d6195a119c3ca1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:42.339827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76c43-78e4-4867-a735-bc6515641bed None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:42.339827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76c43-78e4-4867-a735-bc6515641bed None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:42.339827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76c43-78e4-4867-a735-bc6515641bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:42.368995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f275a7bb9348eb8db958a468b72007'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.370194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f275a7bb9348eb8db958a468b72007'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.383006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3ba76c43-78e4-4867-a735-bc6515641bed None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:42.384966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3ba76c43-78e4-4867-a735-bc6515641bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:42.389595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f275a7bb9348eb8db958a468b72007'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.405018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f275a7bb9348eb8db958a468b72007'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.406296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f275a7bb9348eb8db958a468b72007'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.460124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1039/2045] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:42 2022] DELETE /identity/v3/users/67f275a7bb9348eb8db958a468b72007 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:42.468699 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:42.471207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:42.581042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1007/2046] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:42.619988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76c43-78e4-4867-a735-bc6515641bed None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:42.621919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3ba76c43-78e4-4867-a735-bc6515641bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:42.688215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548776-ed9b-474e-8710-691f715d7703 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:42.698720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:42.699623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:42.700020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:42.708444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] PATH_INFO: `/v3/projects/9d01afcb87734921b3c60fe02db29a3c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:42.710068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d01afcb87734921b3c60fe02db29a3c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:42.711972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:42.742978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76c43-78e4-4867-a735-bc6515641bed None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:42.745902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:42.824567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:42.838970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d01afcb87734921b3c60fe02db29a3c', 'request_id': 'req-feeb9ae5-c89d-4756-97ec-5508e05f5511'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.850075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d01afcb87734921b3c60fe02db29a3c', 'request_id': 'req-feeb9ae5-c89d-4756-97ec-5508e05f5511'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.866351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d01afcb87734921b3c60fe02db29a3c', 'request_id': 'req-feeb9ae5-c89d-4756-97ec-5508e05f5511'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.869592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e4966-0795-45e8-8c8b-7a0b91a3a009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:42.870275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4966-0795-45e8-8c8b-7a0b91a3a009 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:42.870558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4966-0795-45e8-8c8b-7a0b91a3a009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:42.870944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e4966-0795-45e8-8c8b-7a0b91a3a009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:42.898530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] The token cache is being invalidate because project 9d01afcb87734921b3c60fe02db29a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:42.899896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.900964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e4966-0795-45e8-8c8b-7a0b91a3a009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:42.901114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-feeb9ae5-c89d-4756-97ec-5508e05f5511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:42.902233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e4966-0795-45e8-8c8b-7a0b91a3a009 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:42.906971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1040/2047] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:42 2022] DELETE /identity/v3/projects/9d01afcb87734921b3c60fe02db29a3c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:42.912055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374425-14e3-4c41-8f76-50ac313baf7e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:42.912470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374425-14e3-4c41-8f76-50ac313baf7e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:42.912780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b374425-14e3-4c41-8f76-50ac313baf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:42.928719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1008/2048] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:42.975017 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9b374425-14e3-4c41-8f76-50ac313baf7e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:42.976486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9b374425-14e3-4c41-8f76-50ac313baf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:43.092539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1041/2049] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:43.095336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18d6f-151b-4f9c-89f2-663929b9702b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.095820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18d6f-151b-4f9c-89f2-663929b9702b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.096321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18d6f-151b-4f9c-89f2-663929b9702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.140172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0ef18d6f-151b-4f9c-89f2-663929b9702b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:43.143150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0ef18d6f-151b-4f9c-89f2-663929b9702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:43.161245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1009/2050] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:43.165823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b374425-14e3-4c41-8f76-50ac313baf7e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:43.194396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b374425-14e3-4c41-8f76-50ac313baf7e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:43.218309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:43.218309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.218309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.218309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.219338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:43.220212 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:43.222294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:43.266246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1042/2051] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:43.268298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef18d6f-151b-4f9c-89f2-663929b9702b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:43.287157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef18d6f-151b-4f9c-89f2-663929b9702b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:43.298310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cea778-cac8-4bb2-b013-b5be698a9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:43.301316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea778-cac8-4bb2-b013-b5be698a9e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.301316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea778-cac8-4bb2-b013-b5be698a9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.301316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cea778-cac8-4bb2-b013-b5be698a9e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.301316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cea778-cac8-4bb2-b013-b5be698a9e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:43.304506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cea778-cac8-4bb2-b013-b5be698a9e16 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:43.332507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:43.335855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:43.375038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28552-2e8e-4ef5-82b3-98c806d76f67 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:43.377993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1010/2052] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:43 2022] POST /identity/v3/projects => generated 407 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:43.382623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cea778-cac8-4bb2-b013-b5be698a9e16 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:43.495621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:43.496672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.497319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.497752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] PATH_INFO: `/v3/projects/f003587e5dbd44efabc024021c290d7d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.499629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f003587e5dbd44efabc024021c290d7d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:43.501514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cea778-cac8-4bb2-b013-b5be698a9e16 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:43.502337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:43.507776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4017187-78d7-483c-94a5-584b30ac2eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:43.508623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017187-78d7-483c-94a5-584b30ac2eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.509556 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017187-78d7-483c-94a5-584b30ac2eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.509974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017187-78d7-483c-94a5-584b30ac2eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.510881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017187-78d7-483c-94a5-584b30ac2eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:43.513154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017187-78d7-483c-94a5-584b30ac2eb5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:43.552172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1011/2053] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:43 2022] POST /identity/v3/users => generated 304 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:43.556448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4017187-78d7-483c-94a5-584b30ac2eb5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:43.568370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4017187-78d7-483c-94a5-584b30ac2eb5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:43.575659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09a7cb-5b4e-4d51-8f64-f81a7d7703ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:43.577235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a7cb-5b4e-4d51-8f64-f81a7d7703ef admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.577667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a7cb-5b4e-4d51-8f64-f81a7d7703ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.578045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a7cb-5b4e-4d51-8f64-f81a7d7703ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.578969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09a7cb-5b4e-4d51-8f64-f81a7d7703ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:43.580881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09a7cb-5b4e-4d51-8f64-f81a7d7703ef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:43.599106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1012/2054] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:18:43.600345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09a7cb-5b4e-4d51-8f64-f81a7d7703ef admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:43.607158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:43.616534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09a7cb-5b4e-4d51-8f64-f81a7d7703ef admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:43.652519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f003587e5dbd44efabc024021c290d7d', 'request_id': 'req-f4ab1113-4251-4b03-a9de-a0238541282b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.661668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f003587e5dbd44efabc024021c290d7d', 'request_id': 'req-f4ab1113-4251-4b03-a9de-a0238541282b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.676559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f003587e5dbd44efabc024021c290d7d', 'request_id': 'req-f4ab1113-4251-4b03-a9de-a0238541282b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.699521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] The token cache is being invalidate because project f003587e5dbd44efabc024021c290d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:43.700441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.701238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.705710 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1043/2055] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:43 2022] DELETE /identity/v3/projects/f003587e5dbd44efabc024021c290d7d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:43.706624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:43.708709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:43.730124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686657b7-50b6-40b0-ad49-c7422a399188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:43.731644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686657b7-50b6-40b0-ad49-c7422a399188 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.732552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686657b7-50b6-40b0-ad49-c7422a399188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.732665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686657b7-50b6-40b0-ad49-c7422a399188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.734547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686657b7-50b6-40b0-ad49-c7422a399188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:43.737547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686657b7-50b6-40b0-ad49-c7422a399188 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:43.762829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1013/2056] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:43.762829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f482-985f-46f8-863c-31db8cd8ccac None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.762829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f482-985f-46f8-863c-31db8cd8ccac None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.762829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7f482-985f-46f8-863c-31db8cd8ccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.801045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c9b7f482-985f-46f8-863c-31db8cd8ccac None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:43.808905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c9b7f482-985f-46f8-863c-31db8cd8ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:43.817979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab1113-4251-4b03-a9de-a0238541282b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:43.824990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1014/2057] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:43.825553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:43.825681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7f482-985f-46f8-863c-31db8cd8ccac None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:43.827218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c9b7f482-985f-46f8-863c-31db8cd8ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:43.828885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.829535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.830045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] PATH_INFO: `/v3/projects/c60127c1ca334583a6707e6d791f3131` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.831808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60127c1ca334583a6707e6d791f3131)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:43.835982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:43.840750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7f482-985f-46f8-863c-31db8cd8ccac None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:43.846149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d0aa5-7be0-4f20-9eaa-b315beb4a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:43.847645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0aa5-7be0-4f20-9eaa-b315beb4a6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.848163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0aa5-7be0-4f20-9eaa-b315beb4a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.848730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d0aa5-7be0-4f20-9eaa-b315beb4a6f7 admin admin] PATH_INFO: `/v3/projects/e78b8b362d484d88ae0470dc5ccdbcda/users/2e88048c15444c58b05d55df2c4f0b59/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.868315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d0aa5-7be0-4f20-9eaa-b315beb4a6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78b8b362d484d88ae0470dc5ccdbcda, user_id=2e88048c15444c58b05d55df2c4f0b59, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:43.871631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d0aa5-7be0-4f20-9eaa-b315beb4a6f7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:43.885567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:43.902872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1015/2058] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:43 2022] PUT /identity/v3/projects/e78b8b362d484d88ae0470dc5ccdbcda/users/2e88048c15444c58b05d55df2c4f0b59/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:43.905112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d325c-5a5f-4169-a9ef-b4ff37571f85 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.905112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d325c-5a5f-4169-a9ef-b4ff37571f85 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.905112 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d325c-5a5f-4169-a9ef-b4ff37571f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:43.938015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60127c1ca334583a6707e6d791f3131', 'request_id': 'req-75ad4de2-e698-4ce8-86d8-5c16f856a93a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.949468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9a2d325c-5a5f-4169-a9ef-b4ff37571f85 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:43.950754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9a2d325c-5a5f-4169-a9ef-b4ff37571f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:43.957256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60127c1ca334583a6707e6d791f3131', 'request_id': 'req-75ad4de2-e698-4ce8-86d8-5c16f856a93a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.972229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60127c1ca334583a6707e6d791f3131', 'request_id': 'req-75ad4de2-e698-4ce8-86d8-5c16f856a93a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.986091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] The token cache is being invalidate because project c60127c1ca334583a6707e6d791f3131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:43.986091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.986609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-75ad4de2-e698-4ce8-86d8-5c16f856a93a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:43.992100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1044/2059] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:43 2022] DELETE /identity/v3/projects/c60127c1ca334583a6707e6d791f3131 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:43.994216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c224-fc5f-4fbf-b472-44ff00f6377b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:43.994528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c224-fc5f-4fbf-b472-44ff00f6377b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:43.994787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c224-fc5f-4fbf-b472-44ff00f6377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.027839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1016/2060] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:44.027839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d325c-5a5f-4169-a9ef-b4ff37571f85 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.027839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9a2d325c-5a5f-4169-a9ef-b4ff37571f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:44.050623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d325c-5a5f-4169-a9ef-b4ff37571f85 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.050623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.050623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.050623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.051032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] PATH_INFO: `/v3/projects/c1c10d4da0564fc7b15fb786fff67e0d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.051104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8d78c224-fc5f-4fbf-b472-44ff00f6377b None None] MFA Rules not processed for user `2e88048c15444c58b05d55df2c4f0b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:44.051180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c10d4da0564fc7b15fb786fff67e0d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.052917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.059725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8d78c224-fc5f-4fbf-b472-44ff00f6377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:44.127449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c10d4da0564fc7b15fb786fff67e0d', 'request_id': 'req-32a03796-8d40-4396-a4e3-19d5cbfecbf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.135296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c10d4da0564fc7b15fb786fff67e0d', 'request_id': 'req-32a03796-8d40-4396-a4e3-19d5cbfecbf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.140422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:44.148037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c10d4da0564fc7b15fb786fff67e0d', 'request_id': 'req-32a03796-8d40-4396-a4e3-19d5cbfecbf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.185361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] The token cache is being invalidate because project c1c10d4da0564fc7b15fb786fff67e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:44.185657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.192422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32a03796-8d40-4396-a4e3-19d5cbfecbf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.195813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1017/2061] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:44 2022] DELETE /identity/v3/projects/c1c10d4da0564fc7b15fb786fff67e0d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:44.200350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4b70-853d-4461-9e19-5944b9170ba2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.200643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4b70-853d-4461-9e19-5944b9170ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.200922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4b70-853d-4461-9e19-5944b9170ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.228156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1045/2062] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:44.228156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c224-fc5f-4fbf-b472-44ff00f6377b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.247308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c224-fc5f-4fbf-b472-44ff00f6377b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.251055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-114d4b70-853d-4461-9e19-5944b9170ba2 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:44.253825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-114d4b70-853d-4461-9e19-5944b9170ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:44.390664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.392669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.393761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.395176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.396149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:44.397349 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.403826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.409436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1018/2063] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:44.410627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4b70-853d-4461-9e19-5944b9170ba2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.412624 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-114d4b70-853d-4461-9e19-5944b9170ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:44.435503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4b70-853d-4461-9e19-5944b9170ba2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.436060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1046/2064] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:44.437209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.440950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.441331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:44.441862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.442149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.442432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] PATH_INFO: `/v3/users/3eb87863551b486697ad82ef171dfe5d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.443725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb87863551b486697ad82ef171dfe5d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.445751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.461520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e6d48-72e2-4848-9c67-db531e6c612c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.468047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9e9c4-4dfb-4579-90e9-220ee2f69d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.469064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e9c4-4dfb-4579-90e9-220ee2f69d84 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.470121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e9c4-4dfb-4579-90e9-220ee2f69d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.470499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e9c4-4dfb-4579-90e9-220ee2f69d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.471785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9e9c4-4dfb-4579-90e9-220ee2f69d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.474382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9e9c4-4dfb-4579-90e9-220ee2f69d84 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.478057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:44.526611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb87863551b486697ad82ef171dfe5d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.527661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb87863551b486697ad82ef171dfe5d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.534217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1047/2065] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:44 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:44.535841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633553d3-8018-42b0-b11c-cc98d879c877 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.536151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633553d3-8018-42b0-b11c-cc98d879c877 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.536484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633553d3-8018-42b0-b11c-cc98d879c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.555841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb87863551b486697ad82ef171dfe5d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.556732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb87863551b486697ad82ef171dfe5d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.559723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-633553d3-8018-42b0-b11c-cc98d879c877 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:44.561112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-633553d3-8018-42b0-b11c-cc98d879c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:44.568495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb87863551b486697ad82ef171dfe5d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:44.585409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1019/2066] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:44 2022] DELETE /identity/v3/users/3eb87863551b486697ad82ef171dfe5d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:44.586332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.588615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:44.650156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1048/2067] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:44.651187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633553d3-8018-42b0-b11c-cc98d879c877 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.652933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-633553d3-8018-42b0-b11c-cc98d879c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:44.667430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633553d3-8018-42b0-b11c-cc98d879c877 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.709397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8abea1-7b29-408c-9611-1a281c6a5cd2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.719258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a48b9-3098-4b62-9728-37ecbd30f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.719952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a48b9-3098-4b62-9728-37ecbd30f8dc admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.720266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a48b9-3098-4b62-9728-37ecbd30f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.720541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a48b9-3098-4b62-9728-37ecbd30f8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.722705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a48b9-3098-4b62-9728-37ecbd30f8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.728825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a48b9-3098-4b62-9728-37ecbd30f8dc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.748563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:44.767438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444677c-2fb3-4628-8ef2-fde2805571f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.768410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444677c-2fb3-4628-8ef2-fde2805571f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.768708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444677c-2fb3-4628-8ef2-fde2805571f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.769180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444677c-2fb3-4628-8ef2-fde2805571f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.769915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444677c-2fb3-4628-8ef2-fde2805571f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.771220 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1020/2068] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:44 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:44.772410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a48b9-3098-4b62-9728-37ecbd30f8dc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.772909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444677c-2fb3-4628-8ef2-fde2805571f0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.817181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1049/2069] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:44 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:44.818649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444677c-2fb3-4628-8ef2-fde2805571f0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.838517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444677c-2fb3-4628-8ef2-fde2805571f0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.866872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a48b9-3098-4b62-9728-37ecbd30f8dc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.885191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.886095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.886768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.886768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.887781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:44.888396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.890178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.906793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1021/2070] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:44.907655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.927528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6faa1-db75-4127-b4c7-cbe84a592fe7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.933988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370a7f2-0e3f-44db-95f1-a707dddbf8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.934983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370a7f2-0e3f-44db-95f1-a707dddbf8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.935448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370a7f2-0e3f-44db-95f1-a707dddbf8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.935972 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370a7f2-0e3f-44db-95f1-a707dddbf8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.937247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370a7f2-0e3f-44db-95f1-a707dddbf8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.939267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370a7f2-0e3f-44db-95f1-a707dddbf8d4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.954405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1022/2071] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:44.955376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370a7f2-0e3f-44db-95f1-a707dddbf8d4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:44.968864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:44.974281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8700a98-1306-4664-9bb7-2e850b61f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.975284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700a98-1306-4664-9bb7-2e850b61f514 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.975755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700a98-1306-4664-9bb7-2e850b61f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.976242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8700a98-1306-4664-9bb7-2e850b61f514 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.976673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370a7f2-0e3f-44db-95f1-a707dddbf8d4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:44.978308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8700a98-1306-4664-9bb7-2e850b61f514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:44.981560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8700a98-1306-4664-9bb7-2e850b61f514 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:44.992964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231242a1-69b3-4851-875f-7405c36b40ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:44.995503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231242a1-69b3-4851-875f-7405c36b40ed admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:44.996432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231242a1-69b3-4851-875f-7405c36b40ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:44.997017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231242a1-69b3-4851-875f-7405c36b40ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:44.999432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231242a1-69b3-4851-875f-7405c36b40ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.004558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231242a1-69b3-4851-875f-7405c36b40ed admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.016555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1050/2072] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:44 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:45.021443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8700a98-1306-4664-9bb7-2e850b61f514 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.038929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8700a98-1306-4664-9bb7-2e850b61f514 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.046801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90200e1-c851-4c67-a62c-3771a932f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.048141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90200e1-c851-4c67-a62c-3771a932f98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.048520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90200e1-c851-4c67-a62c-3771a932f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.048898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90200e1-c851-4c67-a62c-3771a932f98f admin admin] PATH_INFO: `/v3/projects/dd8372533a154f858ff02fc48d20ca08/users/cfa2b53a07f047c78033b43e2bb70d22/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.052602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1023/2073] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:44 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:45.053778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231242a1-69b3-4851-875f-7405c36b40ed admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.074687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90200e1-c851-4c67-a62c-3771a932f98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8372533a154f858ff02fc48d20ca08, user_id=cfa2b53a07f047c78033b43e2bb70d22, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.078296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90200e1-c851-4c67-a62c-3771a932f98f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.096472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1051/2074] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:45 2022] PUT /identity/v3/projects/dd8372533a154f858ff02fc48d20ca08/users/cfa2b53a07f047c78033b43e2bb70d22/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:45.097378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90200e1-c851-4c67-a62c-3771a932f98f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.202518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231242a1-69b3-4851-875f-7405c36b40ed admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.236950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90200e1-c851-4c67-a62c-3771a932f98f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.244161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6e44-db17-4ca8-864d-caca9e812d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.245184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6e44-db17-4ca8-864d-caca9e812d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.245549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6e44-db17-4ca8-864d-caca9e812d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.245912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff6e44-db17-4ca8-864d-caca9e812d5c admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.246832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff6e44-db17-4ca8-864d-caca9e812d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.251364 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff6e44-db17-4ca8-864d-caca9e812d5c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.278673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1052/2075] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:45 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:45.279955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6e44-db17-4ca8-864d-caca9e812d5c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.304651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff6e44-db17-4ca8-864d-caca9e812d5c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.323328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b266e-70f2-41c5-9897-756f79212e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.325343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b266e-70f2-41c5-9897-756f79212e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.325944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b266e-70f2-41c5-9897-756f79212e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.327051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b266e-70f2-41c5-9897-756f79212e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.329856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b266e-70f2-41c5-9897-756f79212e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.337713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b266e-70f2-41c5-9897-756f79212e82 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.372782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acac0-a709-45a1-890e-a4941d3836a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.373822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acac0-a709-45a1-890e-a4941d3836a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.374219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acac0-a709-45a1-890e-a4941d3836a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.375488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9acac0-a709-45a1-890e-a4941d3836a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.377087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9acac0-a709-45a1-890e-a4941d3836a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.382404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1053/2076] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:45.385432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b266e-70f2-41c5-9897-756f79212e82 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.396202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9acac0-a709-45a1-890e-a4941d3836a1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.416186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b266e-70f2-41c5-9897-756f79212e82 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.429387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf983-cbc0-4468-9e34-b89d39b3777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.430375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf983-cbc0-4468-9e34-b89d39b3777e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.430542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1024/2077] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:45.431317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf983-cbc0-4468-9e34-b89d39b3777e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.431317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf983-cbc0-4468-9e34-b89d39b3777e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.433661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acac0-a709-45a1-890e-a4941d3836a1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.434173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf983-cbc0-4468-9e34-b89d39b3777e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.439232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf983-cbc0-4468-9e34-b89d39b3777e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.457823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9acac0-a709-45a1-890e-a4941d3836a1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.470540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1054/2078] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:45.475167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b089425-7536-4145-a292-161e41382a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.475167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b089425-7536-4145-a292-161e41382a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.475167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b089425-7536-4145-a292-161e41382a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.475167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b089425-7536-4145-a292-161e41382a41 admin admin] PATH_INFO: `/v3/projects/dd8372533a154f858ff02fc48d20ca08/users/cfa2b53a07f047c78033b43e2bb70d22/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.477121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b089425-7536-4145-a292-161e41382a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8372533a154f858ff02fc48d20ca08, user_id=cfa2b53a07f047c78033b43e2bb70d22, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.482583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf983-cbc0-4468-9e34-b89d39b3777e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.484322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b089425-7536-4145-a292-161e41382a41 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.501735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf983-cbc0-4468-9e34-b89d39b3777e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.520187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1025/2079] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:45 2022] PUT /identity/v3/projects/dd8372533a154f858ff02fc48d20ca08/users/cfa2b53a07f047c78033b43e2bb70d22/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:45.520187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b089425-7536-4145-a292-161e41382a41 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.548274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:45.644814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b089425-7536-4145-a292-161e41382a41 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.651187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bab7e-c389-41b4-b6ef-3d57fcd3c4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.652057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bab7e-c389-41b4-b6ef-3d57fcd3c4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.652428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bab7e-c389-41b4-b6ef-3d57fcd3c4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.652782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bab7e-c389-41b4-b6ef-3d57fcd3c4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.653883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bab7e-c389-41b4-b6ef-3d57fcd3c4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.656082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bab7e-c389-41b4-b6ef-3d57fcd3c4ff admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.674191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1026/2080] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:45.679177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4534e-9384-4954-8527-a718ab2238fe None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.679177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4534e-9384-4954-8527-a718ab2238fe None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.679177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4534e-9384-4954-8527-a718ab2238fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.702364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:45.716073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-99c4534e-9384-4954-8527-a718ab2238fe None None] MFA Rules not processed for user `cfa2b53a07f047c78033b43e2bb70d22`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:45.718216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-99c4534e-9384-4954-8527-a718ab2238fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:45.722060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567cd19-a24a-43a9-b419-a7df8be44e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.723570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567cd19-a24a-43a9-b419-a7df8be44e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.724400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567cd19-a24a-43a9-b419-a7df8be44e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.725472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567cd19-a24a-43a9-b419-a7df8be44e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.727722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567cd19-a24a-43a9-b419-a7df8be44e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.731465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567cd19-a24a-43a9-b419-a7df8be44e5e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.764450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1055/2081] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:45.766284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567cd19-a24a-43a9-b419-a7df8be44e5e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.789327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567cd19-a24a-43a9-b419-a7df8be44e5e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:45.799614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cec4c-9216-4bd6-8491-df463b3e8607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:45.801526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cec4c-9216-4bd6-8491-df463b3e8607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.802161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cec4c-9216-4bd6-8491-df463b3e8607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.802755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cec4c-9216-4bd6-8491-df463b3e8607 admin admin] PATH_INFO: `/v3/projects/ae188921864a484d906445ea47d5d34e/users/3ab20743468347ac8cda5b69b4351192/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:45.840001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cec4c-9216-4bd6-8491-df463b3e8607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae188921864a484d906445ea47d5d34e, user_id=3ab20743468347ac8cda5b69b4351192, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:45.848845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cec4c-9216-4bd6-8491-df463b3e8607 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:45.894754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1056/2082] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:45 2022] PUT /identity/v3/projects/ae188921864a484d906445ea47d5d34e/users/3ab20743468347ac8cda5b69b4351192/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:45.896662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cec4c-9216-4bd6-8491-df463b3e8607 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:45.972028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1027/2083] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:45.980703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ff1f-7bc1-4a2e-8ab7-1260aafe5d1c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:45.981188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ff1f-7bc1-4a2e-8ab7-1260aafe5d1c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:45.981666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ff1f-7bc1-4a2e-8ab7-1260aafe5d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:46.061038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cec4c-9216-4bd6-8491-df463b3e8607 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:46.068344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:46.069715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:46.070168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:46.070759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] PATH_INFO: `/v3/projects/5863caab838c476aa27c652676f57247/users/e6fbc07f488e4b82b641aa572e95670f/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:46.079030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4531ff1f-7bc1-4a2e-8ab7-1260aafe5d1c None None] MFA Rules not processed for user `3ab20743468347ac8cda5b69b4351192`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:46.081217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4531ff1f-7bc1-4a2e-8ab7-1260aafe5d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:46.097030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5863caab838c476aa27c652676f57247, user_id=e6fbc07f488e4b82b641aa572e95670f, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:46.100834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:46.142646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1057/2084] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:45 2022] PUT /identity/v3/projects/5863caab838c476aa27c652676f57247/users/e6fbc07f488e4b82b641aa572e95670f/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:46.144497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:46.150714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:46.276204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1028/2085] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:46.288132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315b611-ff89-4229-849d-fd5051969489 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:46.288591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315b611-ff89-4229-849d-fd5051969489 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:46.291904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315b611-ff89-4229-849d-fd5051969489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:46.307122 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ddc55-2a7c-4a04-b17a-01fa7fe23609 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:46.318998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:46.319685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:46.319973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:46.320280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:46.358280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8315b611-ff89-4229-849d-fd5051969489 None None] MFA Rules not processed for user `e6fbc07f488e4b82b641aa572e95670f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:46.359623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8315b611-ff89-4229-849d-fd5051969489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:46.370245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:46.492680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:46.494213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:46.512243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1029/2086] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:46.513447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315b611-ff89-4229-849d-fd5051969489 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:46.515032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8315b611-ff89-4229-849d-fd5051969489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:46.535641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1058/2087] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:46 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:46.536664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:46.538165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:46.564341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315b611-ff89-4229-849d-fd5051969489 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:46.568453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1033d3-7aa2-4b7c-b252-cf5f95e902df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:46.569126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1033d3-7aa2-4b7c-b252-cf5f95e902df service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:46.569416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1033d3-7aa2-4b7c-b252-cf5f95e902df service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:46.573626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1033d3-7aa2-4b7c-b252-cf5f95e902df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:46.596827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:46.674632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ebaf6-87a1-417a-b566-9649e0df1ce3 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:46.686089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:46.686989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:46.687275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:46.687552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] PATH_INFO: `/v3/projects/2d0a2dc619e441beba6ad571bb73d0f0` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:46.690808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0a2dc619e441beba6ad571bb73d0f0)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:46.692831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:46.736843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1033d3-7aa2-4b7c-b252-cf5f95e902df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:46.738947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1033d3-7aa2-4b7c-b252-cf5f95e902df service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:46.756873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1030/2088] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:46.758080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1033d3-7aa2-4b7c-b252-cf5f95e902df service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:46.795906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1033d3-7aa2-4b7c-b252-cf5f95e902df service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:46.814789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0a2dc619e441beba6ad571bb73d0f0', 'request_id': 'req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:46.831730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0a2dc619e441beba6ad571bb73d0f0', 'request_id': 'req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:46.849194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0a2dc619e441beba6ad571bb73d0f0', 'request_id': 'req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:46.865923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] The token cache is being invalidate because project 2d0a2dc619e441beba6ad571bb73d0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:46.866254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:46.869972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b2b21c51-59fe-44eb-9fcc-4c80fe3fe09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:46.876815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1059/2089] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:46 2022] DELETE /identity/v3/projects/2d0a2dc619e441beba6ad571bb73d0f0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:46.878784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8c80-183b-4af8-9459-65938016ff4d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:46.879187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8c80-183b-4af8-9459-65938016ff4d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:46.879709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a8c80-183b-4af8-9459-65938016ff4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:46.909488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b37a8c80-183b-4af8-9459-65938016ff4d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:46.910914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b37a8c80-183b-4af8-9459-65938016ff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:47.029032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:47.029727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:47.031049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:47.031547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:47.031958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:47.033281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:47.040180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:47.084981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1060/2090] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:47.093006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764597-a963-4877-8192-aa4449a2f70c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:47.094957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764597-a963-4877-8192-aa4449a2f70c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:47.095491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764597-a963-4877-8192-aa4449a2f70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:47.131470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1031/2091] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:46 2022] POST /identity/v3/projects => generated 385 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:47.137360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:47.142056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:47.173677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fa764597-a963-4877-8192-aa4449a2f70c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:47.177792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fa764597-a963-4877-8192-aa4449a2f70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:47.367962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1061/2092] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:47.372217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa764597-a963-4877-8192-aa4449a2f70c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:47.382994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c0ebe-81b8-48db-aa14-5d89116337c0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:47.404927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:47.406107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:47.406570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:47.407231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:47.408639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:47.410661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:47.458348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa764597-a963-4877-8192-aa4449a2f70c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:47.460949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1032/2093] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:47 2022] POST /identity/v3/users => generated 299 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:18:47.463279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:47.466258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:47.484517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:47.485872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:47.486325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:47.486610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:47.487732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:47.488047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:47.491095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:47.557519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:47.559135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1062/2094] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:47.560234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:47.584481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b34b0-02b6-4d3b-abad-729e0b0d2cc2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:47.600982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:47.601695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:47.602118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:47.602397 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:47.603244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:47.605267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:47.616864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059e06-cfcd-43e5-9eea-2791551dcc7e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:47.628298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:47.632562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:47.633020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:47.633479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:47.635488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1063/2095] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:47.636394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:47.637463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:47.638135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:47.677608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c7f45-2561-4b04-8925-17307baf1f6a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:47.689833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:47.690801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:47.691148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:47.691400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] PATH_INFO: `/v3/users/966ee0a48096481f8b849a3dcfc03964` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:47.695469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966ee0a48096481f8b849a3dcfc03964)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:47.708200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:47.795859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:47.797709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:47.814716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1033/2096] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:47.815590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:47.828644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881e01a-52e3-445f-a785-7bea512fa045 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:47.835716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:47.836490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:47.836782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:47.837690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:47.838402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:47.840650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:47.841229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966ee0a48096481f8b849a3dcfc03964'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:47.844948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966ee0a48096481f8b849a3dcfc03964'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:47.878512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966ee0a48096481f8b849a3dcfc03964'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:47.894721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966ee0a48096481f8b849a3dcfc03964'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:47.895434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966ee0a48096481f8b849a3dcfc03964'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:47.907867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1034/2097] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:47 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:47.910886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:47.936500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:47.939265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1064/2098] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:47 2022] DELETE /identity/v3/users/966ee0a48096481f8b849a3dcfc03964 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:47.944973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:47.946959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:48.090235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:48.169173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf98c6-d8bb-4ffc-acdf-56d6e1f97c98 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:48.183689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13a33a-95e2-421a-8d63-b50e39a8c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:48.186505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13a33a-95e2-421a-8d63-b50e39a8c73a admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.186505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13a33a-95e2-421a-8d63-b50e39a8c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.186505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13a33a-95e2-421a-8d63-b50e39a8c73a admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.198523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13a33a-95e2-421a-8d63-b50e39a8c73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:48.205812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13a33a-95e2-421a-8d63-b50e39a8c73a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:48.244720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1802e1-41bd-45e2-9723-e46811493627 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:48.255754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1065/2099] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:47 2022] POST /identity/v3/users => generated 292 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:48.257089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678204f-d71c-437b-9ac7-7f6febdadcfe None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.257436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678204f-d71c-437b-9ac7-7f6febdadcfe None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.258011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678204f-d71c-437b-9ac7-7f6febdadcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.263960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:48.266002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.267443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.267754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] PATH_INFO: `/v3/projects/b87b6e74e0ba49e28e5b126d19218263/users/4c0bf54e4a584ea091cb45af5f8271de/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.287766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0678204f-d71c-437b-9ac7-7f6febdadcfe None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:48.289914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0678204f-d71c-437b-9ac7-7f6febdadcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:48.312269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87b6e74e0ba49e28e5b126d19218263, user_id=4c0bf54e4a584ea091cb45af5f8271de, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:48.315587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:48.332001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1066/2100] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:48.332001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678204f-d71c-437b-9ac7-7f6febdadcfe None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:48.347192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1035/2101] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:47 2022] PUT /identity/v3/projects/b87b6e74e0ba49e28e5b126d19218263/users/4c0bf54e4a584ea091cb45af5f8271de/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:48.348411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:48.350581 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:48.366363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678204f-d71c-437b-9ac7-7f6febdadcfe None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:48.450598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:48.482308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d0e9d-5bdc-40e1-ae9a-0ebf45216206 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:48.497464 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d09ba-b724-4d83-a3f3-5904c71d02b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:48.498967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d09ba-b724-4d83-a3f3-5904c71d02b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.499276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d09ba-b724-4d83-a3f3-5904c71d02b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.499564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d09ba-b724-4d83-a3f3-5904c71d02b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.583633 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5db8f-6457-46b4-994a-ecc22fe4cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:48.585099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5db8f-6457-46b4-994a-ecc22fe4cbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.585694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5db8f-6457-46b4-994a-ecc22fe4cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.586337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5db8f-6457-46b4-994a-ecc22fe4cbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.588505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5db8f-6457-46b4-994a-ecc22fe4cbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:48.597950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5db8f-6457-46b4-994a-ecc22fe4cbd8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:48.642226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1067/2102] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:48.644183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5db8f-6457-46b4-994a-ecc22fe4cbd8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:48.674692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d09ba-b724-4d83-a3f3-5904c71d02b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:48.676445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d09ba-b724-4d83-a3f3-5904c71d02b9 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:48.691509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5db8f-6457-46b4-994a-ecc22fe4cbd8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:48.708141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1036/2103] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:48.709215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d09ba-b724-4d83-a3f3-5904c71d02b9 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:48.710983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf8291-caa1-41b0-b9aa-4f1634ab0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:48.714892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf8291-caa1-41b0-b9aa-4f1634ab0900 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.720930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf8291-caa1-41b0-b9aa-4f1634ab0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.722019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf8291-caa1-41b0-b9aa-4f1634ab0900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.723873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf8291-caa1-41b0-b9aa-4f1634ab0900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:48.727335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf8291-caa1-41b0-b9aa-4f1634ab0900 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:48.735900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d09ba-b724-4d83-a3f3-5904c71d02b9 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:48.751366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599ddc8-0004-4065-8ef1-6b9b0d99aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:48.752067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599ddc8-0004-4065-8ef1-6b9b0d99aa32 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.752385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599ddc8-0004-4065-8ef1-6b9b0d99aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.752667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599ddc8-0004-4065-8ef1-6b9b0d99aa32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.753433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599ddc8-0004-4065-8ef1-6b9b0d99aa32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:48.755135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599ddc8-0004-4065-8ef1-6b9b0d99aa32 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:48.758372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1068/2104] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:48.760844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf8291-caa1-41b0-b9aa-4f1634ab0900 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:48.783086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1037/2105] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:48.784129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599ddc8-0004-4065-8ef1-6b9b0d99aa32 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:48.802200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf8291-caa1-41b0-b9aa-4f1634ab0900 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:48.814708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599ddc8-0004-4065-8ef1-6b9b0d99aa32 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:48.824311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776fe03-aa5a-46a8-a238-53cf21d2bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:48.828470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dec9f-3e0d-47d3-9297-20af46ceaf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:48.829401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dec9f-3e0d-47d3-9297-20af46ceaf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.829683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dec9f-3e0d-47d3-9297-20af46ceaf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.829965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dec9f-3e0d-47d3-9297-20af46ceaf77 admin admin] PATH_INFO: `/v3/projects/1c6d76fbdc1b42ca99a99bfbabdec7b6/users/f66a105fbca444a5b5aabe470818c09c/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.830691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776fe03-aa5a-46a8-a238-53cf21d2bbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.832780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776fe03-aa5a-46a8-a238-53cf21d2bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.834728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776fe03-aa5a-46a8-a238-53cf21d2bbb2 admin admin] PATH_INFO: `/v3/projects/b87b6e74e0ba49e28e5b126d19218263/users/4c0bf54e4a584ea091cb45af5f8271de/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.843040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776fe03-aa5a-46a8-a238-53cf21d2bbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87b6e74e0ba49e28e5b126d19218263, user_id=4c0bf54e4a584ea091cb45af5f8271de, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:48.858089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776fe03-aa5a-46a8-a238-53cf21d2bbb2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:48.865771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dec9f-3e0d-47d3-9297-20af46ceaf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6d76fbdc1b42ca99a99bfbabdec7b6, user_id=f66a105fbca444a5b5aabe470818c09c, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:48.879548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dec9f-3e0d-47d3-9297-20af46ceaf77 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:48.910215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1038/2107] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:48 2022] PUT /identity/v3/projects/1c6d76fbdc1b42ca99a99bfbabdec7b6/users/f66a105fbca444a5b5aabe470818c09c/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:48.911920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1069/2107] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:48 2022] PUT /identity/v3/projects/b87b6e74e0ba49e28e5b126d19218263/users/4c0bf54e4a584ea091cb45af5f8271de/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:48.922387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb0fc8-8448-4d79-a611-d53471c56162 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.922691 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb0fc8-8448-4d79-a611-d53471c56162 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.923093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb0fc8-8448-4d79-a611-d53471c56162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.924263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef37a-d503-40ed-b7ff-54bf2046503b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:48.925194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef37a-d503-40ed-b7ff-54bf2046503b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:48.926579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ef37a-d503-40ed-b7ff-54bf2046503b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:48.977070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-af5ef37a-d503-40ed-b7ff-54bf2046503b None None] MFA Rules not processed for user `f66a105fbca444a5b5aabe470818c09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:48.977367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-29fb0fc8-8448-4d79-a611-d53471c56162 None None] MFA Rules not processed for user `4c0bf54e4a584ea091cb45af5f8271de`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:48.978781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-29fb0fc8-8448-4d79-a611-d53471c56162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:48.979690 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-af5ef37a-d503-40ed-b7ff-54bf2046503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:49.144944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1070/2108] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:49.166437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef37a-d503-40ed-b7ff-54bf2046503b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:49.169148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-af5ef37a-d503-40ed-b7ff-54bf2046503b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:49.198451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1039/2109] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:49.277608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:49.353909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ef37a-d503-40ed-b7ff-54bf2046503b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:49.355405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb0fc8-8448-4d79-a611-d53471c56162 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:49.358227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fe42c-70c2-4768-a4bb-6347538febf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:49.358366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-29fb0fc8-8448-4d79-a611-d53471c56162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:49.358907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fe42c-70c2-4768-a4bb-6347538febf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:49.359191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fe42c-70c2-4768-a4bb-6347538febf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:49.359469 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fe42c-70c2-4768-a4bb-6347538febf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:49.374560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fe42c-70c2-4768-a4bb-6347538febf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:49.376540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fe42c-70c2-4768-a4bb-6347538febf2 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:49.386175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb0fc8-8448-4d79-a611-d53471c56162 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:49.392389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1071/2110] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:18:49.395066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:49.406184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:49.407233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:49.408409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:49.426368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fe42c-70c2-4768-a4bb-6347538febf2 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:49.432919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:49.436195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:49.453739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1040/2111] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:49.496280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:49.498434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:49.597376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fe42c-70c2-4768-a4bb-6347538febf2 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:49.597827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:49.605451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:49.606359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:49.606931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:49.607220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] PATH_INFO: `/v3/users/f66a105fbca444a5b5aabe470818c09c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:49.609414 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66a105fbca444a5b5aabe470818c09c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:49.613342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:49.653791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84644e13-86d0-434b-a7d7-9acd80e59e88 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:49.667630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:49.669957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:49.669957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:49.670794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] PATH_INFO: `/v3/projects/06fa886fa6e548f191c249169c249500` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:49.676196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06fa886fa6e548f191c249169c249500)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:49.679518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:49.731355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66a105fbca444a5b5aabe470818c09c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.737785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66a105fbca444a5b5aabe470818c09c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.764959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66a105fbca444a5b5aabe470818c09c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.787057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66a105fbca444a5b5aabe470818c09c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.788236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-43bd2332-b8ab-498f-9a98-5c6d3e3e78ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66a105fbca444a5b5aabe470818c09c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.807730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06fa886fa6e548f191c249169c249500', 'request_id': 'req-75943962-befc-4162-a5ba-8fb1fb30b975'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.827049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06fa886fa6e548f191c249169c249500', 'request_id': 'req-75943962-befc-4162-a5ba-8fb1fb30b975'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.842935 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06fa886fa6e548f191c249169c249500', 'request_id': 'req-75943962-befc-4162-a5ba-8fb1fb30b975'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.861229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1072/2112] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:49 2022] DELETE /identity/v3/users/f66a105fbca444a5b5aabe470818c09c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:49.866665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84ca1-0cf0-462f-9ddf-f3a6d29ddaa4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:49.867142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84ca1-0cf0-462f-9ddf-f3a6d29ddaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:49.867617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d84ca1-0cf0-462f-9ddf-f3a6d29ddaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:49.876644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] The token cache is being invalidate because project 06fa886fa6e548f191c249169c249500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:49.877568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.880223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:49.885357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1041/2113] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:49 2022] DELETE /identity/v3/projects/06fa886fa6e548f191c249169c249500 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:49.890862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:49.897554 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:49.907919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e3d84ca1-0cf0-462f-9ddf-f3a6d29ddaa4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:49.911092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e3d84ca1-0cf0-462f-9ddf-f3a6d29ddaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:50.007893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:50.079956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1073/2114] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:18:50.095604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d84ca1-0cf0-462f-9ddf-f3a6d29ddaa4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:50.098592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e3d84ca1-0cf0-462f-9ddf-f3a6d29ddaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:50.134735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75943962-befc-4162-a5ba-8fb1fb30b975 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:50.140737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:50.141678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:50.142623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:50.142939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] PATH_INFO: `/v3/users/9656946853e54fafabc68cc40d252992` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:50.144736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9656946853e54fafabc68cc40d252992)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:50.147692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:50.231183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9656946853e54fafabc68cc40d252992'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.231911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9656946853e54fafabc68cc40d252992'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.242753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d84ca1-0cf0-462f-9ddf-f3a6d29ddaa4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:50.247346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:50.251697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9656946853e54fafabc68cc40d252992'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.252929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9656946853e54fafabc68cc40d252992'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.253801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3747017-9f1d-41a4-9805-625b8024cddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:50.257011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747017-9f1d-41a4-9805-625b8024cddf service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:50.264905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747017-9f1d-41a4-9805-625b8024cddf service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:50.265515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3747017-9f1d-41a4-9805-625b8024cddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:50.271458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9656946853e54fafabc68cc40d252992'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.271734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d3747017-9f1d-41a4-9805-625b8024cddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:50.294474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3747017-9f1d-41a4-9805-625b8024cddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:50.297482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3747017-9f1d-41a4-9805-625b8024cddf service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:50.302362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1042/2115] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:49 2022] DELETE /identity/v3/users/9656946853e54fafabc68cc40d252992 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:50.314365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1074/2116] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:50.652063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:50.655288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:50.799427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bf995-04a3-4617-a5c7-db54053dba44 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:50.812035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:50.816424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:50.817240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:50.818302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] PATH_INFO: `/v3/users/e6fbc07f488e4b82b641aa572e95670f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:50.823430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fbc07f488e4b82b641aa572e95670f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:50.827789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:50.940019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fbc07f488e4b82b641aa572e95670f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.941087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fbc07f488e4b82b641aa572e95670f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.966084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fbc07f488e4b82b641aa572e95670f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.967173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fbc07f488e4b82b641aa572e95670f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:50.978814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fbc07f488e4b82b641aa572e95670f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.002228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1043/2117] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:50 2022] DELETE /identity/v3/users/e6fbc07f488e4b82b641aa572e95670f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:51.011584 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771db69-5924-4868-afe0-eb0f1060ca1d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.012198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771db69-5924-4868-afe0-eb0f1060ca1d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.013044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771db69-5924-4868-afe0-eb0f1060ca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.045305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6771db69-5924-4868-afe0-eb0f1060ca1d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:51.048273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6771db69-5924-4868-afe0-eb0f1060ca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.172943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:51.175564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.195436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1075/2118] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:51.207631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771db69-5924-4868-afe0-eb0f1060ca1d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:51.214359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6771db69-5924-4868-afe0-eb0f1060ca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.299094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:51.304315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684c5e4-c271-403f-add9-1a3867b53c82 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:51.316887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:51.317938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.318138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.318968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] PATH_INFO: `/v3/projects/1c6d76fbdc1b42ca99a99bfbabdec7b6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.321253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6d76fbdc1b42ca99a99bfbabdec7b6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:51.324185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:51.334963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771db69-5924-4868-afe0-eb0f1060ca1d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:51.341707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:51.342750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.343215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.343495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.356037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:51.357817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:51.374662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1076/2119] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:51.375694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:51.377529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.394041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cc04f-c50a-4ad7-ac07-0fc5c624a098 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:51.400834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:51.401737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.402325 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.402636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] PATH_INFO: `/v3/projects/73e1019bb2b34751afe04cafa9939630` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.404489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e1019bb2b34751afe04cafa9939630)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:51.406971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:51.429418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6d76fbdc1b42ca99a99bfbabdec7b6', 'request_id': 'req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.444015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6d76fbdc1b42ca99a99bfbabdec7b6', 'request_id': 'req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.465072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6d76fbdc1b42ca99a99bfbabdec7b6', 'request_id': 'req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.485457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:51.497611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] The token cache is being invalidate because project 1c6d76fbdc1b42ca99a99bfbabdec7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:51.497611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.498701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-11118c34-8f05-41c6-a7ce-a5d8a1c6fb84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.506380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1044/2120] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:51 2022] DELETE /identity/v3/projects/1c6d76fbdc1b42ca99a99bfbabdec7b6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:51.508616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bca6f-1daa-403a-9276-31cd709e3ce3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.510551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bca6f-1daa-403a-9276-31cd709e3ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.511273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bca6f-1daa-403a-9276-31cd709e3ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.566244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e1019bb2b34751afe04cafa9939630', 'request_id': 'req-ffc6ca05-3426-4d84-9257-543815bf48a4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.577002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-659bca6f-1daa-403a-9276-31cd709e3ce3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:51.579905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e1019bb2b34751afe04cafa9939630', 'request_id': 'req-ffc6ca05-3426-4d84-9257-543815bf48a4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.581219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-659bca6f-1daa-403a-9276-31cd709e3ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.598586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e1019bb2b34751afe04cafa9939630', 'request_id': 'req-ffc6ca05-3426-4d84-9257-543815bf48a4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.629118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] The token cache is being invalidate because project 73e1019bb2b34751afe04cafa9939630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:51.632754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.635892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ffc6ca05-3426-4d84-9257-543815bf48a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:51.641370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1077/2121] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:51 2022] DELETE /identity/v3/projects/73e1019bb2b34751afe04cafa9939630 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:51.650074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72157c4b-031e-4724-a3c4-4b8bfa4bf72c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.662973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72157c4b-031e-4724-a3c4-4b8bfa4bf72c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.666491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72157c4b-031e-4724-a3c4-4b8bfa4bf72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.744722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-72157c4b-031e-4724-a3c4-4b8bfa4bf72c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:51.755634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-72157c4b-031e-4724-a3c4-4b8bfa4bf72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.785626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1078/2122] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:51.794055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1045/2123] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:51.802713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d7cc-7431-4a94-9e16-f56f0797c6cc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.803366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544842-2b27-4525-8e05-28bbc0119741 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.804142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544842-2b27-4525-8e05-28bbc0119741 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.804386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544842-2b27-4525-8e05-28bbc0119741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.807406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d7cc-7431-4a94-9e16-f56f0797c6cc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.808708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06d7cc-7431-4a94-9e16-f56f0797c6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.855596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-dd06d7cc-7431-4a94-9e16-f56f0797c6cc None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:51.857244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dd06d7cc-7431-4a94-9e16-f56f0797c6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.877809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6e544842-2b27-4525-8e05-28bbc0119741 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:51.881921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6e544842-2b27-4525-8e05-28bbc0119741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.895022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1079/2124] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:51.896626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06d7cc-7431-4a94-9e16-f56f0797c6cc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:51.908989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06d7cc-7431-4a94-9e16-f56f0797c6cc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:51.914565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:51.917522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.917802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.918181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.919381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:51.919883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:51.922104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:51.924615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1046/2125] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:51.927333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e544842-2b27-4525-8e05-28bbc0119741 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:51.934562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6e544842-2b27-4525-8e05-28bbc0119741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:51.964032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1080/2126] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:51.966529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:51.984424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e544842-2b27-4525-8e05-28bbc0119741 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:51.989467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be91fa2-5c21-4934-8324-9490de91d5b2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:51.991780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:51.992702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:51.993615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:51.996662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] PATH_INFO: `/v3/projects/5863caab838c476aa27c652676f57247` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:51.996662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5863caab838c476aa27c652676f57247)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:51.997479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.001118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.002243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.002706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.003056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.004341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:52.004621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.006411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.029158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1081/2127] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:52.030251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.042123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37230c4d-a272-4b7f-845f-1e51b1d10dd2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.051249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e2558-e42d-46cb-9f6a-64211b2dab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.052206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2558-e42d-46cb-9f6a-64211b2dab2d admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.052528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2558-e42d-46cb-9f6a-64211b2dab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.052977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e2558-e42d-46cb-9f6a-64211b2dab2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.053649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e2558-e42d-46cb-9f6a-64211b2dab2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.056162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e2558-e42d-46cb-9f6a-64211b2dab2d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.095000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5863caab838c476aa27c652676f57247', 'request_id': 'req-a623933b-d3ee-449b-a796-6f2f7938570c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.100815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1082/2128] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:52 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:52.105755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e2558-e42d-46cb-9f6a-64211b2dab2d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.106745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5863caab838c476aa27c652676f57247', 'request_id': 'req-a623933b-d3ee-449b-a796-6f2f7938570c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.118207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5863caab838c476aa27c652676f57247', 'request_id': 'req-a623933b-d3ee-449b-a796-6f2f7938570c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.134387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] The token cache is being invalidate because project 5863caab838c476aa27c652676f57247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:52.134676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.135420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.137559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1047/2129] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:51 2022] DELETE /identity/v3/projects/5863caab838c476aa27c652676f57247 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:52.138073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.139632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:52.147461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:52.228420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e2558-e42d-46cb-9f6a-64211b2dab2d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.234358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623933b-d3ee-449b-a796-6f2f7938570c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.241872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465b46-2d0e-4c3a-957f-9753a9524861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.242651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.243087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465b46-2d0e-4c3a-957f-9753a9524861 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.244372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465b46-2d0e-4c3a-957f-9753a9524861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.244803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.244952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465b46-2d0e-4c3a-957f-9753a9524861 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.245435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.246059 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.246236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465b46-2d0e-4c3a-957f-9753a9524861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.247195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.249849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.250135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465b46-2d0e-4c3a-957f-9753a9524861 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.283247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1048/2130] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:52 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:52.285005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.287689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:52.307478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1083/2131] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:52 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:52.309728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465b46-2d0e-4c3a-957f-9753a9524861 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.328562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d73758-c393-40c5-bd1f-5a747665a9ee admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.401779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:52.451468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465b46-2d0e-4c3a-957f-9753a9524861 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.452533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.453450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.453732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.454171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] PATH_INFO: `/v3/users/4c0bf54e4a584ea091cb45af5f8271de` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.458705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0bf54e4a584ea091cb45af5f8271de)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.459131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.460307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.460661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.460999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.461909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.463767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.464153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.488216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1084/2132] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:52.491535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.494040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:52.512934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdddd46-12bf-42df-be9f-c9b7eb63a533 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.527995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2da5-055d-465a-b65d-9db542317a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.528784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2da5-055d-465a-b65d-9db542317a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.529078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2da5-055d-465a-b65d-9db542317a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.530114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2da5-055d-465a-b65d-9db542317a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.531978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e2da5-055d-465a-b65d-9db542317a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.534062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e2da5-055d-465a-b65d-9db542317a30 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.562601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1085/2133] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:52 2022] POST /identity/v3/users => generated 293 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:52.563571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2da5-055d-465a-b65d-9db542317a30 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.576315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2da5-055d-465a-b65d-9db542317a30 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.582954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f527c7a-4ca3-4524-8ef9-dc77720fefd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.583667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527c7a-4ca3-4524-8ef9-dc77720fefd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.583953 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527c7a-4ca3-4524-8ef9-dc77720fefd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.584280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527c7a-4ca3-4524-8ef9-dc77720fefd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.585078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f527c7a-4ca3-4524-8ef9-dc77720fefd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.586983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f527c7a-4ca3-4524-8ef9-dc77720fefd0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.601808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0bf54e4a584ea091cb45af5f8271de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.603456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0bf54e4a584ea091cb45af5f8271de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.609551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1086/2134] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:52.611324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f527c7a-4ca3-4524-8ef9-dc77720fefd0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.621985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0bf54e4a584ea091cb45af5f8271de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.623575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0bf54e4a584ea091cb45af5f8271de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.631389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f527c7a-4ca3-4524-8ef9-dc77720fefd0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.636841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0bf54e4a584ea091cb45af5f8271de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:52.641612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.642858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.643261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.643545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.644970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.648255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.671152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1049/2135] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:52 2022] DELETE /identity/v3/users/4c0bf54e4a584ea091cb45af5f8271de => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:52.672449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.677532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1087/2136] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:52.677532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.680294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:52.692373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:52.706971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895269b-3295-4521-8796-6cdf7fc6ec50 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.734199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:52.845708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05994d5c-0433-44a8-828f-f17519bebb22 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.851466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee695d-9daf-40d9-a5f4-a91aaf358eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.853131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee695d-9daf-40d9-a5f4-a91aaf358eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.853417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee695d-9daf-40d9-a5f4-a91aaf358eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.853695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee695d-9daf-40d9-a5f4-a91aaf358eb4 admin admin] PATH_INFO: `/v3/projects/0f41cb04aea94aec9d5014f97c4d7b1d/users/d3038ea5d7724f469a8037208faee10d/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.859549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08434aa-cd73-4ccb-be16-e2ae8d6d67b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:52.860435 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08434aa-cd73-4ccb-be16-e2ae8d6d67b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.860792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08434aa-cd73-4ccb-be16-e2ae8d6d67b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.861142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08434aa-cd73-4ccb-be16-e2ae8d6d67b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.862118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08434aa-cd73-4ccb-be16-e2ae8d6d67b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.864436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08434aa-cd73-4ccb-be16-e2ae8d6d67b1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.875704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee695d-9daf-40d9-a5f4-a91aaf358eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f41cb04aea94aec9d5014f97c4d7b1d, user_id=d3038ea5d7724f469a8037208faee10d, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:52.879257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee695d-9daf-40d9-a5f4-a91aaf358eb4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:52.884181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1088/2137] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:52.888493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08434aa-cd73-4ccb-be16-e2ae8d6d67b1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:52.942044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1050/2138] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:52 2022] PUT /identity/v3/projects/0f41cb04aea94aec9d5014f97c4d7b1d/users/d3038ea5d7724f469a8037208faee10d/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:52.943666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91d58-9aeb-4e3f-904a-804db8de226c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:52.943958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91d58-9aeb-4e3f-904a-804db8de226c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:52.944266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b91d58-9aeb-4e3f-904a-804db8de226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:52.945344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08434aa-cd73-4ccb-be16-e2ae8d6d67b1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:52.998087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-93b91d58-9aeb-4e3f-904a-804db8de226c None None] MFA Rules not processed for user `d3038ea5d7724f469a8037208faee10d`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:53.000936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-93b91d58-9aeb-4e3f-904a-804db8de226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:53.100715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9025-4cc5-4f66-89bc-f9511edc0b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.102614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9025-4cc5-4f66-89bc-f9511edc0b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.103170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9025-4cc5-4f66-89bc-f9511edc0b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.104043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9025-4cc5-4f66-89bc-f9511edc0b25 admin admin] PATH_INFO: `/v3/projects/e798a806469e4b3590f74fd044959531/users/37d6734df5964e39b94b99641c08387d/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.152296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9025-4cc5-4f66-89bc-f9511edc0b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e798a806469e4b3590f74fd044959531, user_id=37d6734df5964e39b94b99641c08387d, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.167940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9025-4cc5-4f66-89bc-f9511edc0b25 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.208988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1089/2139] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:52 2022] PUT /identity/v3/projects/e798a806469e4b3590f74fd044959531/users/37d6734df5964e39b94b99641c08387d/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:53.219789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532bb8-aa69-4c09-9f29-548843ab37b7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.220134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532bb8-aa69-4c09-9f29-548843ab37b7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.220413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60532bb8-aa69-4c09-9f29-548843ab37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.248261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1051/2140] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:53.248261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b91d58-9aeb-4e3f-904a-804db8de226c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.248261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-93b91d58-9aeb-4e3f-904a-804db8de226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:53.272711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b91d58-9aeb-4e3f-904a-804db8de226c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:53.279446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:53.284677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-60532bb8-aa69-4c09-9f29-548843ab37b7 None None] MFA Rules not processed for user `37d6734df5964e39b94b99641c08387d`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:53.286232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-60532bb8-aa69-4c09-9f29-548843ab37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:53.392530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.394179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.394733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.396167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] PATH_INFO: `/v3/projects/b87b6e74e0ba49e28e5b126d19218263` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.405396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87b6e74e0ba49e28e5b126d19218263)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.408395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.430497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1090/2141] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:18:53.432499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60532bb8-aa69-4c09-9f29-548843ab37b7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.450493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60532bb8-aa69-4c09-9f29-548843ab37b7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:53.457012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.457818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.458549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.458854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.459676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.463096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.467164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:53.493830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87b6e74e0ba49e28e5b126d19218263', 'request_id': 'req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:53.501273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1091/2142] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:53 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:53.502298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.504309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:53.505789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87b6e74e0ba49e28e5b126d19218263', 'request_id': 'req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:53.519083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87b6e74e0ba49e28e5b126d19218263', 'request_id': 'req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:53.558040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] The token cache is being invalidate because project b87b6e74e0ba49e28e5b126d19218263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:53.558429 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:53.562352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:53.566073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1052/2143] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:53 2022] DELETE /identity/v3/projects/b87b6e74e0ba49e28e5b126d19218263 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:53.567844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.569504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:53.616532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba3450-f9a4-474b-ac54-98d9401d51e5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:53.623440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b8949-754b-4699-ac20-5360abacb8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.625932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8949-754b-4699-ac20-5360abacb8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.626633 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8949-754b-4699-ac20-5360abacb8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.627464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b8949-754b-4699-ac20-5360abacb8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.632571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cd2b8949-754b-4699-ac20-5360abacb8c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:53.668026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca0216-9b0d-46bd-a6e1-08fa82224aa8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:53.724088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b8949-754b-4699-ac20-5360abacb8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.725632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b8949-754b-4699-ac20-5360abacb8c6 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.735548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1092/2144] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:53.737070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fa103-98a6-4d7e-a0ce-13b5d0350845 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.737350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fa103-98a6-4d7e-a0ce-13b5d0350845 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.737679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fa103-98a6-4d7e-a0ce-13b5d0350845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.770738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0f1fa103-98a6-4d7e-a0ce-13b5d0350845 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:53.773028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0f1fa103-98a6-4d7e-a0ce-13b5d0350845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:53.775176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f2f4-64c1-41ab-8257-fc2146c130f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.775880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f2f4-64c1-41ab-8257-fc2146c130f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.776197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f2f4-64c1-41ab-8257-fc2146c130f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.776545 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23f2f4-64c1-41ab-8257-fc2146c130f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.777174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23f2f4-64c1-41ab-8257-fc2146c130f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.779394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23f2f4-64c1-41ab-8257-fc2146c130f5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.789481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1093/2145] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:53.804432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb9a59-6b2f-4f79-8447-60c02302dafb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.804918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb9a59-6b2f-4f79-8447-60c02302dafb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.805428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb9a59-6b2f-4f79-8447-60c02302dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.826668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1053/2146] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:53 2022] POST /identity/v3/users => generated 290 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:53.831521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f2f4-64c1-41ab-8257-fc2146c130f5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.832771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-81fb9a59-6b2f-4f79-8447-60c02302dafb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:53.834080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-81fb9a59-6b2f-4f79-8447-60c02302dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:53.845288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1094/2147] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:53.850644 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb9a59-6b2f-4f79-8447-60c02302dafb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.853128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23f2f4-64c1-41ab-8257-fc2146c130f5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:53.861830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb9a59-6b2f-4f79-8447-60c02302dafb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:53.865035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a630-9bbe-4113-bfaa-cf727c297d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.866353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a630-9bbe-4113-bfaa-cf727c297d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.867442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a630-9bbe-4113-bfaa-cf727c297d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.867932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a630-9bbe-4113-bfaa-cf727c297d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.868190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.868976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.869259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.869560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.869666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140a630-9bbe-4113-bfaa-cf727c297d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.870331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:53.870639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.872096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140a630-9bbe-4113-bfaa-cf727c297d5e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.872324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.888190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1054/2148] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:53.891146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a630-9bbe-4113-bfaa-cf727c297d5e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.893395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1095/2149] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:53.894198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.905671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b92e9-c3d6-419b-a21f-7a5a02d79e2a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:53.906612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a630-9bbe-4113-bfaa-cf727c297d5e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:53.911885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af4178-de2f-48d7-9e52-d87762eadf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.912618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af4178-de2f-48d7-9e52-d87762eadf3c admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.913192 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af4178-de2f-48d7-9e52-d87762eadf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.913478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af4178-de2f-48d7-9e52-d87762eadf3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.914182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af4178-de2f-48d7-9e52-d87762eadf3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.915154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687b692-b403-4c0e-bff3-8a35e3c93125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:53.916196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af4178-de2f-48d7-9e52-d87762eadf3c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.916605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687b692-b403-4c0e-bff3-8a35e3c93125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:53.916976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687b692-b403-4c0e-bff3-8a35e3c93125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:53.917426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687b692-b403-4c0e-bff3-8a35e3c93125 admin admin] PATH_INFO: `/v3/projects/958bbbb4531544569cb2080716c8a635/users/13f440b86f7d4ec3ac15dbb3f3f8c82c/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:53.921765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:53.952575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1096/2150] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:53 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:53.952824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687b692-b403-4c0e-bff3-8a35e3c93125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958bbbb4531544569cb2080716c8a635, user_id=13f440b86f7d4ec3ac15dbb3f3f8c82c, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:53.955818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af4178-de2f-48d7-9e52-d87762eadf3c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:53.958616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687b692-b403-4c0e-bff3-8a35e3c93125 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:53.990802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1055/2151] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:53 2022] PUT /identity/v3/projects/958bbbb4531544569cb2080716c8a635/users/13f440b86f7d4ec3ac15dbb3f3f8c82c/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:53.993138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687b692-b403-4c0e-bff3-8a35e3c93125 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.018822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:54.059460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af4178-de2f-48d7-9e52-d87762eadf3c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.111695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687b692-b403-4c0e-bff3-8a35e3c93125 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.124157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5134079-814b-4d16-9d5c-452666c708c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.127225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134079-814b-4d16-9d5c-452666c708c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.127513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134079-814b-4d16-9d5c-452666c708c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.127801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134079-814b-4d16-9d5c-452666c708c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.129003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5134079-814b-4d16-9d5c-452666c708c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.130678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5134079-814b-4d16-9d5c-452666c708c0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:54.144156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1056/2152] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:54.149720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5134079-814b-4d16-9d5c-452666c708c0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.172533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5134079-814b-4d16-9d5c-452666c708c0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.174896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b39d1b-9023-4157-a647-a6452a740313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.175606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b39d1b-9023-4157-a647-a6452a740313 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.175875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b39d1b-9023-4157-a647-a6452a740313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.176220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b39d1b-9023-4157-a647-a6452a740313 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.176917 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b39d1b-9023-4157-a647-a6452a740313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.178162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb034e9-43ba-4ad5-8da0-d6ba69ec4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.179127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb034e9-43ba-4ad5-8da0-d6ba69ec4030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.179432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b39d1b-9023-4157-a647-a6452a740313 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:54.179538 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb034e9-43ba-4ad5-8da0-d6ba69ec4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.185145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb034e9-43ba-4ad5-8da0-d6ba69ec4030 admin admin] PATH_INFO: `/v3/projects/958bbbb4531544569cb2080716c8a635/users/13f440b86f7d4ec3ac15dbb3f3f8c82c/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.185145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb034e9-43ba-4ad5-8da0-d6ba69ec4030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958bbbb4531544569cb2080716c8a635, user_id=13f440b86f7d4ec3ac15dbb3f3f8c82c, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.185792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb034e9-43ba-4ad5-8da0-d6ba69ec4030 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:54.201596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1057/2153] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:54 2022] PUT /identity/v3/projects/958bbbb4531544569cb2080716c8a635/users/13f440b86f7d4ec3ac15dbb3f3f8c82c/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:54.214912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647def3-5979-4407-bdb5-4bd60c38b3b2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.215209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647def3-5979-4407-bdb5-4bd60c38b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.215487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647def3-5979-4407-bdb5-4bd60c38b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.221507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1097/2154] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:53 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:54.225746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b39d1b-9023-4157-a647-a6452a740313 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.237970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b39d1b-9023-4157-a647-a6452a740313 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.265754 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3647def3-5979-4407-bdb5-4bd60c38b3b2 None None] MFA Rules not processed for user `13f440b86f7d4ec3ac15dbb3f3f8c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:54.267026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3647def3-5979-4407-bdb5-4bd60c38b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.309838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.310573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.310865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.311220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.312001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.313835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:54.326115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1098/2155] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:54.329981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.331530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.345403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b9f1-5e69-4681-9f96-28eb6a295a84 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.350607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.351504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.351792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.352074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] PATH_INFO: `/v3/users/3ab20743468347ac8cda5b69b4351192` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.353960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab20743468347ac8cda5b69b4351192)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.354414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1058/2156] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:54.355487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647def3-5979-4407-bdb5-4bd60c38b3b2 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.355924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:54.369207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647def3-5979-4407-bdb5-4bd60c38b3b2 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.374333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.375020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.375183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:54.375310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.375595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.376376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.378576 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:54.392663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1059/2157] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:54.393628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.395591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.416337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab20743468347ac8cda5b69b4351192'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:54.417042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab20743468347ac8cda5b69b4351192'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:54.424946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab20743468347ac8cda5b69b4351192'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:54.434769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab20743468347ac8cda5b69b4351192'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:54.435556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab20743468347ac8cda5b69b4351192'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:54.466063 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1099/2158] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:54 2022] DELETE /identity/v3/users/3ab20743468347ac8cda5b69b4351192 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:54.469277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.470959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.476903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538745c-ea1e-465e-b585-a35d8b3acb4d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.524077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:54.559089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aa753-849f-4e07-bf8d-0bc3650f8986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.559925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aa753-849f-4e07-bf8d-0bc3650f8986 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.560616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aa753-849f-4e07-bf8d-0bc3650f8986 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.560998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aa753-849f-4e07-bf8d-0bc3650f8986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.564033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7f2aa753-849f-4e07-bf8d-0bc3650f8986 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.588403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38b27-4128-469d-9ecd-29d2086210aa admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.597398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa933d96-7719-4c5e-8cb9-ee06c888d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.600713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa933d96-7719-4c5e-8cb9-ee06c888d483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.600904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa933d96-7719-4c5e-8cb9-ee06c888d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.601229 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa933d96-7719-4c5e-8cb9-ee06c888d483 admin admin] PATH_INFO: `/v3/projects/2658d953b5ba4c758ec590aa4735ccb5/users/2696ca1dde664bd88abc592052b6e88f/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.623870 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa933d96-7719-4c5e-8cb9-ee06c888d483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2658d953b5ba4c758ec590aa4735ccb5, user_id=2696ca1dde664bd88abc592052b6e88f, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.626758 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa933d96-7719-4c5e-8cb9-ee06c888d483 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:54.648186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1100/2159] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:54 2022] PUT /identity/v3/projects/2658d953b5ba4c758ec590aa4735ccb5/users/2696ca1dde664bd88abc592052b6e88f/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:54.648186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533f187-e8e6-407b-8158-3e0ab3a3cd62 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.648186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533f187-e8e6-407b-8158-3e0ab3a3cd62 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.648186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533f187-e8e6-407b-8158-3e0ab3a3cd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.650397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aa753-849f-4e07-bf8d-0bc3650f8986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.652035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aa753-849f-4e07-bf8d-0bc3650f8986 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:54.663369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1060/2160] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:54.664696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7533f187-e8e6-407b-8158-3e0ab3a3cd62 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:54.665766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a3568-7a98-4588-86c6-d03aacfd7e1b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.665766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a3568-7a98-4588-86c6-d03aacfd7e1b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.666061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a3568-7a98-4588-86c6-d03aacfd7e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.666878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7533f187-e8e6-407b-8158-3e0ab3a3cd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.708253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b83a3568-7a98-4588-86c6-d03aacfd7e1b None None] MFA Rules not processed for user `2696ca1dde664bd88abc592052b6e88f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:54.711992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b83a3568-7a98-4588-86c6-d03aacfd7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.789470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1101/2161] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:54.797244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533f187-e8e6-407b-8158-3e0ab3a3cd62 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.799116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7533f187-e8e6-407b-8158-3e0ab3a3cd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.828022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:54.881919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1061/2162] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:54.885593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a3568-7a98-4588-86c6-d03aacfd7e1b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:54.887869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b83a3568-7a98-4588-86c6-d03aacfd7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.889885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533f187-e8e6-407b-8158-3e0ab3a3cd62 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:54.896709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:54.897445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:54.897731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:54.898007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:54.900663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:54.985607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:54.988622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.005620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1102/2163] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:55.009907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a3568-7a98-4588-86c6-d03aacfd7e1b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:55.017692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:55.018739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.019233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.019734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.021320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:55.041447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:55.041705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd9472-b15b-4a38-b03c-f4a8ade8df82 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:55.044153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.049641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d6409-813a-4ee5-af8c-39ffc2f3a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:55.050819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d6409-813a-4ee5-af8c-39ffc2f3a297 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.051737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d6409-813a-4ee5-af8c-39ffc2f3a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.052339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d6409-813a-4ee5-af8c-39ffc2f3a297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.056650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d6409-813a-4ee5-af8c-39ffc2f3a297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:55.060556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d6409-813a-4ee5-af8c-39ffc2f3a297 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.063189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1062/2164] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:55.064727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:55.067753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:55.091876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44716e-86cd-44da-a7cc-16ffffcb823f service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:55.100764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:55.103306 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.103901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.104540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] PATH_INFO: `/v3/users/2e88048c15444c58b05d55df2c4f0b59` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.107285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e88048c15444c58b05d55df2c4f0b59)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:55.111606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.118719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1103/2165] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:55 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:55.122460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d6409-813a-4ee5-af8c-39ffc2f3a297 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:55.123119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:55.214768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e88048c15444c58b05d55df2c4f0b59'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:55.216358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e88048c15444c58b05d55df2c4f0b59'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:55.252989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e88048c15444c58b05d55df2c4f0b59'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:55.254526 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e88048c15444c58b05d55df2c4f0b59'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:55.269908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cc685689-29c4-439b-b98a-7ec3a2787d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e88048c15444c58b05d55df2c4f0b59'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:55.297599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1063/2166] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:55 2022] DELETE /identity/v3/users/2e88048c15444c58b05d55df2c4f0b59 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:55.301468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d6409-813a-4ee5-af8c-39ffc2f3a297 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:55.305118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4fbb-e564-4c68-907b-b327042f18b3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.305328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4fbb-e564-4c68-907b-b327042f18b3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.306155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce4fbb-e564-4c68-907b-b327042f18b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.370266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-04ce4fbb-e564-4c68-907b-b327042f18b3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:55.374016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-04ce4fbb-e564-4c68-907b-b327042f18b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:55.446127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:55.462085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:55.462085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.462085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.462085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.462523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:55.462615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.500160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1104/2167] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:55 2022] POST /identity/v3/users => generated 299 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:18:55.503993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:55.507036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:55.548127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a4dd-90fc-4674-843f-bed9360e9426 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:55.566327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:55.567722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.568488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.570008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.572417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:55.577623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.582978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1064/2168] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:55.606690 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1105/2169] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:55.611117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce4fbb-e564-4c68-907b-b327042f18b3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:55.619240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:55.628726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:55.629209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce4fbb-e564-4c68-907b-b327042f18b3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:55.648222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:55.651038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.651038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.651038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] PATH_INFO: `/v3/projects/360631c763ce46baac8cf1b58a37ca83/users/1fcc6ec5d9304226b3439760428a7a60/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.697647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] RBAC: Authorizing `identity:create_grant(project_id=360631c763ce46baac8cf1b58a37ca83, user_id=1fcc6ec5d9304226b3439760428a7a60, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:55.697647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.720192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1065/2170] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:55 2022] PUT /identity/v3/projects/360631c763ce46baac8cf1b58a37ca83/users/1fcc6ec5d9304226b3439760428a7a60/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:55.723922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:55.730097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:55.851625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671ec11-29d8-4e68-b6e5-619dda2c759b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:55.861697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f89316-384b-4d0c-b3af-bc5a04c08391 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:55.862807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:55.865401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.865951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.866544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] PATH_INFO: `/v3/projects/ae188921864a484d906445ea47d5d34e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.869615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae188921864a484d906445ea47d5d34e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:55.876359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.880123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:55.940374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564b4a8-61ad-4e18-be00-80a623474c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:55.941109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564b4a8-61ad-4e18-be00-80a623474c64 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:55.941562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564b4a8-61ad-4e18-be00-80a623474c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:55.941848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564b4a8-61ad-4e18-be00-80a623474c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:55.954384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae188921864a484d906445ea47d5d34e', 'request_id': 'req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:55.956486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564b4a8-61ad-4e18-be00-80a623474c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:55.958127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564b4a8-61ad-4e18-be00-80a623474c64 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:55.966016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae188921864a484d906445ea47d5d34e', 'request_id': 'req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:55.971488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1106/2171] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:55.972214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564b4a8-61ad-4e18-be00-80a623474c64 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:55.981111 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae188921864a484d906445ea47d5d34e', 'request_id': 'req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:55.986398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564b4a8-61ad-4e18-be00-80a623474c64 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.002117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] The token cache is being invalidate because project ae188921864a484d906445ea47d5d34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:56.002434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:56.003588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2a9aa0cb-d74f-47d8-8a38-fc756f91f3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:56.016184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1066/2172] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:55 2022] DELETE /identity/v3/projects/ae188921864a484d906445ea47d5d34e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:56.020608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931e6d-e521-4f90-af40-fbc27fa1b43a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.021184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931e6d-e521-4f90-af40-fbc27fa1b43a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.021895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931e6d-e521-4f90-af40-fbc27fa1b43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.046927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-80931e6d-e521-4f90-af40-fbc27fa1b43a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:56.048779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-80931e6d-e521-4f90-af40-fbc27fa1b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:56.066925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.068632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.068632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.068632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.069291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.071859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:56.086925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1107/2173] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:56.094834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:56.099324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:56.124468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e855-bc2a-4e87-8290-44ba56ece464 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.139405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846fe6b-3b5d-4312-bebc-6197eebe9e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.140382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846fe6b-3b5d-4312-bebc-6197eebe9e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.140672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846fe6b-3b5d-4312-bebc-6197eebe9e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.141867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846fe6b-3b5d-4312-bebc-6197eebe9e7d admin admin] PATH_INFO: `/v3/projects/360631c763ce46baac8cf1b58a37ca83/users/1fcc6ec5d9304226b3439760428a7a60/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.143166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846fe6b-3b5d-4312-bebc-6197eebe9e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=360631c763ce46baac8cf1b58a37ca83, user_id=1fcc6ec5d9304226b3439760428a7a60, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.145964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846fe6b-3b5d-4312-bebc-6197eebe9e7d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:56.181367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1108/2174] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:56 2022] PUT /identity/v3/projects/360631c763ce46baac8cf1b58a37ca83/users/1fcc6ec5d9304226b3439760428a7a60/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:18:56.182132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1067/2175] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:56.199819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0185b-a453-43b0-8b2d-696c0162c9f3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.200381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0185b-a453-43b0-8b2d-696c0162c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.200913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0185b-a453-43b0-8b2d-696c0162c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.205704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1ec0-edc1-416a-9e49-23058cc9d725 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.206291 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1ec0-edc1-416a-9e49-23058cc9d725 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.206810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1ec0-edc1-416a-9e49-23058cc9d725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.245071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5cd0185b-a453-43b0-8b2d-696c0162c9f3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:56.246730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5cd0185b-a453-43b0-8b2d-696c0162c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:56.265026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:56.277962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e17f1ec0-edc1-416a-9e49-23058cc9d725 None None] MFA Rules not processed for user `1fcc6ec5d9304226b3439760428a7a60`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:56.280562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e17f1ec0-edc1-416a-9e49-23058cc9d725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:56.365465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1109/2176] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:56.371425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0185b-a453-43b0-8b2d-696c0162c9f3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:56.402737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0185b-a453-43b0-8b2d-696c0162c9f3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.420574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1068/2177] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:56.449388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.450502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.451054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.451414 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.453269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:56.453816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.457181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:56.460352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f1ec0-edc1-416a-9e49-23058cc9d725 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:56.462909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e17f1ec0-edc1-416a-9e49-23058cc9d725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:56.500760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1110/2178] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:56.502513 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:56.527168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:56.545467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b80e21-9f86-44c7-bf89-d1e42ad1b0a0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.564451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42aeb38-d06a-44d4-aad5-8ea9d04ad9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.565559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aeb38-d06a-44d4-aad5-8ea9d04ad9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.565840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aeb38-d06a-44d4-aad5-8ea9d04ad9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.566947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42aeb38-d06a-44d4-aad5-8ea9d04ad9f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.568210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42aeb38-d06a-44d4-aad5-8ea9d04ad9f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.571505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42aeb38-d06a-44d4-aad5-8ea9d04ad9f2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:56.604077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f1ec0-edc1-416a-9e49-23058cc9d725 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.608895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.609684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.609885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.610292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.613058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:56.617153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1111/2179] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:56 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:56.622123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42aeb38-d06a-44d4-aad5-8ea9d04ad9f2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:56.760934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.763393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:56.765984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42aeb38-d06a-44d4-aad5-8ea9d04ad9f2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.775019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d733aaa-7033-4b0f-ab79-06106481a1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.775736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d733aaa-7033-4b0f-ab79-06106481a1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.776028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d733aaa-7033-4b0f-ab79-06106481a1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.776415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d733aaa-7033-4b0f-ab79-06106481a1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.777394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d733aaa-7033-4b0f-ab79-06106481a1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.779866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d733aaa-7033-4b0f-ab79-06106481a1c3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:56.791390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1069/2180] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:56.793717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:56.796368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:56.826359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1112/2181] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:56 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:56.830860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d733aaa-7033-4b0f-ab79-06106481a1c3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:56.838633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a49b-2f87-4ba3-9a01-563503a66393 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.858376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d733aaa-7033-4b0f-ab79-06106481a1c3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.860528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.861426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.861713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.861995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] PATH_INFO: `/v3/projects/e78b8b362d484d88ae0470dc5ccdbcda` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.863364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78b8b362d484d88ae0470dc5ccdbcda)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.865375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:56.872283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.882773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.883081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.883446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.885109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.887131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:56.907993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1113/2182] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:56.907993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:56.909471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:56.946786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091713c-711c-4d0c-8ba8-705dde5ebf7d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:56.959207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:56.962922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:56.963674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:56.964408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] PATH_INFO: `/v3/users/37d6734df5964e39b94b99641c08387d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:56.966996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d6734df5964e39b94b99641c08387d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:56.971393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:57.002531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78b8b362d484d88ae0470dc5ccdbcda', 'request_id': 'req-d5e3da2b-0825-40e1-9444-b5c8998851ce'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.017855 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78b8b362d484d88ae0470dc5ccdbcda', 'request_id': 'req-d5e3da2b-0825-40e1-9444-b5c8998851ce'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.037155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78b8b362d484d88ae0470dc5ccdbcda', 'request_id': 'req-d5e3da2b-0825-40e1-9444-b5c8998851ce'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.062950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d6734df5964e39b94b99641c08387d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.064573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d6734df5964e39b94b99641c08387d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.074002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] The token cache is being invalidate because project e78b8b362d484d88ae0470dc5ccdbcda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:57.074491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.076479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.077769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:57.079196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1070/2183] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:56 2022] DELETE /identity/v3/projects/e78b8b362d484d88ae0470dc5ccdbcda => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:57.080135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:57.086321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:57.094851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d6734df5964e39b94b99641c08387d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.109040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d6734df5964e39b94b99641c08387d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.111301 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d6734df5964e39b94b99641c08387d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.153772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1114/2184] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:56 2022] DELETE /identity/v3/users/37d6734df5964e39b94b99641c08387d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:57.153772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:57.153772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:57.254540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:57.278636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3da2b-0825-40e1-9444-b5c8998851ce admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:57.310413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa1f5f-1c23-44d6-bdb8-28ea4a9c5be0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:57.332285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:57.334497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:57.334996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:57.336045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] PATH_INFO: `/v3/users/cfa2b53a07f047c78033b43e2bb70d22` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:57.338802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa2b53a07f047c78033b43e2bb70d22)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:57.343053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:57.543433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa2b53a07f047c78033b43e2bb70d22'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.546379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa2b53a07f047c78033b43e2bb70d22'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.560014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e2d90-4e1a-4dca-855a-7008d99b862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:57.563435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2d90-4e1a-4dca-855a-7008d99b862a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:57.563735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2d90-4e1a-4dca-855a-7008d99b862a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:57.564031 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2d90-4e1a-4dca-855a-7008d99b862a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:57.564891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e2d90-4e1a-4dca-855a-7008d99b862a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:57.575189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa2b53a07f047c78033b43e2bb70d22'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.578937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e2d90-4e1a-4dca-855a-7008d99b862a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:57.600022 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa2b53a07f047c78033b43e2bb70d22'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.601548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa2b53a07f047c78033b43e2bb70d22'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:57.625370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1071/2185] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 546 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:57.628977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc9f7-6986-4dcc-bf78-654d94780ec7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:57.629534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc9f7-6986-4dcc-bf78-654d94780ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:57.629904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc9f7-6986-4dcc-bf78-654d94780ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:57.658550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1115/2186] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:18:57 2022] DELETE /identity/v3/users/cfa2b53a07f047c78033b43e2bb70d22 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:57.658550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:57.658550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:57.678737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-838dc9f7-6986-4dcc-bf78-654d94780ec7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:57.680141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-838dc9f7-6986-4dcc-bf78-654d94780ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:57.780826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:57.814913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1072/2187] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:57.815523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd01758-c148-41ed-995c-52ff3b994bcb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:57.825491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9568fa-def0-466e-874c-9d4f25ae9d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:57.827342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9568fa-def0-466e-874c-9d4f25ae9d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:57.827981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9568fa-def0-466e-874c-9d4f25ae9d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:57.828395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9568fa-def0-466e-874c-9d4f25ae9d06 admin admin] PATH_INFO: `/v3/projects/d8e387a5a31e41449a0d8fd20ea30e6f/users/046e25a0bb8b48869cd7a80ea457f122/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:57.830730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc9f7-6986-4dcc-bf78-654d94780ec7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:57.834130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-838dc9f7-6986-4dcc-bf78-654d94780ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:57.860218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9568fa-def0-466e-874c-9d4f25ae9d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e387a5a31e41449a0d8fd20ea30e6f, user_id=046e25a0bb8b48869cd7a80ea457f122, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:57.863437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9568fa-def0-466e-874c-9d4f25ae9d06 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:57.892012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1116/2188] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:57 2022] PUT /identity/v3/projects/d8e387a5a31e41449a0d8fd20ea30e6f/users/046e25a0bb8b48869cd7a80ea457f122/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:57.909669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b620d-978f-46bc-aff5-f6f730953618 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:57.910238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b620d-978f-46bc-aff5-f6f730953618 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:57.910781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b620d-978f-46bc-aff5-f6f730953618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:57.952620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc9f7-6986-4dcc-bf78-654d94780ec7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:57.979193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-328b620d-978f-46bc-aff5-f6f730953618 None None] MFA Rules not processed for user `046e25a0bb8b48869cd7a80ea457f122`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:57.982142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-328b620d-978f-46bc-aff5-f6f730953618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:58.073611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:58.075867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:58.077140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:58.077637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:58.091036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1117/2189] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:18:58.099568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:58.108569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b620d-978f-46bc-aff5-f6f730953618 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:58.110928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-328b620d-978f-46bc-aff5-f6f730953618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:58.226340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b620d-978f-46bc-aff5-f6f730953618 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:58.232836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:58.233171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80410f13-d869-46c7-b005-e001bef7b896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:58.233900 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80410f13-d869-46c7-b005-e001bef7b896 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:58.234568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80410f13-d869-46c7-b005-e001bef7b896 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:58.234757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:58.235872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80410f13-d869-46c7-b005-e001bef7b896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:58.249430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80410f13-d869-46c7-b005-e001bef7b896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:58.251634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80410f13-d869-46c7-b005-e001bef7b896 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:58.252399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1073/2190] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:18:58.254321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:58.257445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:58.273266 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1118/2191] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:18:58.298003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96554c9-49f6-418a-a35e-153223b83ec7 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:58.303858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:58.304848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:58.305138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:58.305403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] PATH_INFO: `/v3/projects/dd8372533a154f858ff02fc48d20ca08` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:58.306814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8372533a154f858ff02fc48d20ca08)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:58.308855 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:58.381396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8372533a154f858ff02fc48d20ca08', 'request_id': 'req-b6672f52-e98f-4746-a24a-4189ac56cf77'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:58.397535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8372533a154f858ff02fc48d20ca08', 'request_id': 'req-b6672f52-e98f-4746-a24a-4189ac56cf77'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:58.415357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8372533a154f858ff02fc48d20ca08', 'request_id': 'req-b6672f52-e98f-4746-a24a-4189ac56cf77'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:58.437509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] The token cache is being invalidate because project dd8372533a154f858ff02fc48d20ca08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:58.438041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:58.439601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b6672f52-e98f-4746-a24a-4189ac56cf77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:58.443851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1074/2192] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:58 2022] DELETE /identity/v3/projects/dd8372533a154f858ff02fc48d20ca08 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:58.450860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41e71f-205b-4d0a-955d-4ea7b5d871d4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:58.451332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41e71f-205b-4d0a-955d-4ea7b5d871d4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:58.452099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41e71f-205b-4d0a-955d-4ea7b5d871d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:58.514704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3a41e71f-205b-4d0a-955d-4ea7b5d871d4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:58.516709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3a41e71f-205b-4d0a-955d-4ea7b5d871d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:58.703274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1119/2193] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:58.717808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97685-72e0-4f66-8c4e-2ad0e6182325 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:58.718982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97685-72e0-4f66-8c4e-2ad0e6182325 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:58.719561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a97685-72e0-4f66-8c4e-2ad0e6182325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:58.762443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-15a97685-72e0-4f66-8c4e-2ad0e6182325 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:58.764885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-15a97685-72e0-4f66-8c4e-2ad0e6182325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:58.782467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1075/2194] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:58.790955 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41e71f-205b-4d0a-955d-4ea7b5d871d4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:58.815188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41e71f-205b-4d0a-955d-4ea7b5d871d4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:58.828462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:58.830371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:58.831114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:58.831807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:58.833982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:58.834694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:58.840033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:58.843385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:58.873978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1120/2195] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:18:58.882006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a97685-72e0-4f66-8c4e-2ad0e6182325 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:58.906850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a97685-72e0-4f66-8c4e-2ad0e6182325 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:58.927804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:58.929719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762cf7d-2a86-4b84-b047-727257a3d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:58.932068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:58.933630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762cf7d-2a86-4b84-b047-727257a3d4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:58.934292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762cf7d-2a86-4b84-b047-727257a3d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:58.935814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762cf7d-2a86-4b84-b047-727257a3d4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:58.938246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762cf7d-2a86-4b84-b047-727257a3d4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:58.949286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762cf7d-2a86-4b84-b047-727257a3d4b3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:58.995191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddacb8b-3fc5-4982-a9fb-d0c592d38e8c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:59.017171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:59.019697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.021394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.023450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] PATH_INFO: `/v3/projects/e798a806469e4b3590f74fd044959531` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.027637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e798a806469e4b3590f74fd044959531)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:59.029825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:59.050262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1076/2196] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:58 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:59.059968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762cf7d-2a86-4b84-b047-727257a3d4b3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:59.161397 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e798a806469e4b3590f74fd044959531', 'request_id': 'req-061e1b09-2146-4fab-8397-717ee38e5bb4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:59.176235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e798a806469e4b3590f74fd044959531', 'request_id': 'req-061e1b09-2146-4fab-8397-717ee38e5bb4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:59.186283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762cf7d-2a86-4b84-b047-727257a3d4b3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:59.191676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e798a806469e4b3590f74fd044959531', 'request_id': 'req-061e1b09-2146-4fab-8397-717ee38e5bb4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:59.193541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:59.226697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] The token cache is being invalidate because project e798a806469e4b3590f74fd044959531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:18:59.227030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:59.228954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-061e1b09-2146-4fab-8397-717ee38e5bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:18:59.242340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1121/2197] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:18:58 2022] DELETE /identity/v3/projects/e798a806469e4b3590f74fd044959531 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:59.248517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ef69-6d88-4f99-86a5-8002c75aa20f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.250435 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ef69-6d88-4f99-86a5-8002c75aa20f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.251202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ef69-6d88-4f99-86a5-8002c75aa20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.324939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1ae2ef69-6d88-4f99-86a5-8002c75aa20f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:59.326596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1ae2ef69-6d88-4f99-86a5-8002c75aa20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:59.361911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:59.363008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.363436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.363889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.365527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:59.371698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:59.444015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1077/2198] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:59 2022] POST /identity/v3/users => generated 285 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:59.445054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:59.459078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:59.486250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51605788-2607-43ae-8990-119f7a075070 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:59.488245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1122/2199] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:59.500852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe83bb-0d6a-4f2a-abea-fbe37d88cd30 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.501320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe83bb-0d6a-4f2a-abea-fbe37d88cd30 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.501778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe83bb-0d6a-4f2a-abea-fbe37d88cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.509621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695df1c-5359-4f44-ab7e-e0fd4fc2a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:59.511207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695df1c-5359-4f44-ab7e-e0fd4fc2a5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.513418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695df1c-5359-4f44-ab7e-e0fd4fc2a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.514204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695df1c-5359-4f44-ab7e-e0fd4fc2a5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.515422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695df1c-5359-4f44-ab7e-e0fd4fc2a5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:59.519293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695df1c-5359-4f44-ab7e-e0fd4fc2a5a3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:59.577218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ebfe83bb-0d6a-4f2a-abea-fbe37d88cd30 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:59.577218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ebfe83bb-0d6a-4f2a-abea-fbe37d88cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:59.584824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1078/2200] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:18:59.591680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695df1c-5359-4f44-ab7e-e0fd4fc2a5a3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:59.598864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1123/2201] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:18:59.604035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe83bb-0d6a-4f2a-abea-fbe37d88cd30 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:59.635993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe83bb-0d6a-4f2a-abea-fbe37d88cd30 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:59.639238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695df1c-5359-4f44-ab7e-e0fd4fc2a5a3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:59.647742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:59.648642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.649134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.649763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.652050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:18:59.652968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:59.656317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:59.671964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fafd54-9731-42ef-bab2-272f46880ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:59.673021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fafd54-9731-42ef-bab2-272f46880ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.673533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fafd54-9731-42ef-bab2-272f46880ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.673907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fafd54-9731-42ef-bab2-272f46880ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.676157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fafd54-9731-42ef-bab2-272f46880ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:59.678662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fafd54-9731-42ef-bab2-272f46880ca5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:59.709575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1079/2202] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:18:59.717728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1124/2203] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:18:59.718477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fafd54-9731-42ef-bab2-272f46880ca5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:59.719524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:59.735706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fafd54-9731-42ef-bab2-272f46880ca5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:59.746265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4e25a-fdee-4bac-b20b-15c3d60e11fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:59.747831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4e25a-fdee-4bac-b20b-15c3d60e11fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.748353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4e25a-fdee-4bac-b20b-15c3d60e11fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.748834 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4e25a-fdee-4bac-b20b-15c3d60e11fe admin admin] PATH_INFO: `/v3/projects/efd6ce35f1f046da9df361003854cb1f/users/047f58e96e6340d7bd00558233e551c9/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.750806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ffe36-08dc-428f-9705-9ef40875aba2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:18:59.771782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecffd7-ccff-44b7-8844-4b6962ba1ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:18:59.774911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecffd7-ccff-44b7-8844-4b6962ba1ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.775445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecffd7-ccff-44b7-8844-4b6962ba1ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.775939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecffd7-ccff-44b7-8844-4b6962ba1ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.777744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecffd7-ccff-44b7-8844-4b6962ba1ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:59.782410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ecffd7-ccff-44b7-8844-4b6962ba1ceb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:59.792713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4e25a-fdee-4bac-b20b-15c3d60e11fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd6ce35f1f046da9df361003854cb1f, user_id=047f58e96e6340d7bd00558233e551c9, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:18:59.798375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4e25a-fdee-4bac-b20b-15c3d60e11fe admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:18:59.829523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1080/2204] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:18:59 2022] PUT /identity/v3/projects/efd6ce35f1f046da9df361003854cb1f/users/047f58e96e6340d7bd00558233e551c9/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:18:59.834675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1125/2205] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:18:59 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:18:59.841782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4e25a-fdee-4bac-b20b-15c3d60e11fe admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:18:59.843497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67708f5-b0fc-4479-8f52-49b528d5d59e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:18:59.844489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67708f5-b0fc-4479-8f52-49b528d5d59e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:18:59.845334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67708f5-b0fc-4479-8f52-49b528d5d59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:18:59.898759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d67708f5-b0fc-4479-8f52-49b528d5d59e None None] MFA Rules not processed for user `047f58e96e6340d7bd00558233e551c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:18:59.901723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d67708f5-b0fc-4479-8f52-49b528d5d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:18:59.961570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:18:59.970899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4e25a-fdee-4bac-b20b-15c3d60e11fe admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:00.063399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1126/2206] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:00.079125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67708f5-b0fc-4479-8f52-49b528d5d59e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:00.082175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d67708f5-b0fc-4479-8f52-49b528d5d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:00.112854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:00.136304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a881216-fdad-4c00-94dc-eeff1c4c237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:00.137574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881216-fdad-4c00-94dc-eeff1c4c237d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:00.138162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881216-fdad-4c00-94dc-eeff1c4c237d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:00.138936 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a881216-fdad-4c00-94dc-eeff1c4c237d admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:00.140456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a881216-fdad-4c00-94dc-eeff1c4c237d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:00.144345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a881216-fdad-4c00-94dc-eeff1c4c237d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:00.189395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1081/2207] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:18:59 2022] POST /identity/v3/users => generated 288 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:00.197642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a881216-fdad-4c00-94dc-eeff1c4c237d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:00.217341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a881216-fdad-4c00-94dc-eeff1c4c237d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:00.223987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781988e9-fa4f-432a-8c5d-8ca94eb6dd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:00.224909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781988e9-fa4f-432a-8c5d-8ca94eb6dd69 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:00.225355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781988e9-fa4f-432a-8c5d-8ca94eb6dd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:00.225519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781988e9-fa4f-432a-8c5d-8ca94eb6dd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:00.226414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781988e9-fa4f-432a-8c5d-8ca94eb6dd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:00.228743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781988e9-fa4f-432a-8c5d-8ca94eb6dd69 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:00.244478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1082/2208] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:00.253586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781988e9-fa4f-432a-8c5d-8ca94eb6dd69 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:00.267419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781988e9-fa4f-432a-8c5d-8ca94eb6dd69 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:00.271348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67708f5-b0fc-4479-8f52-49b528d5d59e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:00.278014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbc8f-57fc-490d-adff-ecb79b8ddd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:00.280979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbc8f-57fc-490d-adff-ecb79b8ddd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:00.281460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbc8f-57fc-490d-adff-ecb79b8ddd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:00.281739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedbc8f-57fc-490d-adff-ecb79b8ddd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:00.282499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbc8f-57fc-490d-adff-ecb79b8ddd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:00.284198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedbc8f-57fc-490d-adff-ecb79b8ddd0a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:00.286910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54074d44-c2fe-4485-9d0e-b234c84f8c8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c97bd14230147a5bd004c71f5387098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:00.293315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074d44-c2fe-4485-9d0e-b234c84f8c8f service glance] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:00.293715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074d44-c2fe-4485-9d0e-b234c84f8c8f service glance] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:00.294012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074d44-c2fe-4485-9d0e-b234c84f8c8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:00.306373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1083/2209] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:00.309535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbc8f-57fc-490d-adff-ecb79b8ddd0a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:00.324893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedbc8f-57fc-490d-adff-ecb79b8ddd0a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:00.329457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54074d44-c2fe-4485-9d0e-b234c84f8c8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:00.333282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:00.333595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54074d44-c2fe-4485-9d0e-b234c84f8c8f service glance] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:00.335202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:00.335878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:00.336514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] PATH_INFO: `/v3/projects/5a89571bdcb748a4aae538c5827f6361/users/2395b5604780462a87c9da3bcf620949/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:00.356271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1127/2210] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:19:00.367816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a89571bdcb748a4aae538c5827f6361, user_id=2395b5604780462a87c9da3bcf620949, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:00.374313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:00.396377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1084/2211] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:00 2022] PUT /identity/v3/projects/5a89571bdcb748a4aae538c5827f6361/users/2395b5604780462a87c9da3bcf620949/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:00.418496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3515-9978-4a53-b250-79288685c55a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:00.419294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3515-9978-4a53-b250-79288685c55a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:00.420056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3515-9978-4a53-b250-79288685c55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:00.482565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8f5a3515-9978-4a53-b250-79288685c55a None None] MFA Rules not processed for user `2395b5604780462a87c9da3bcf620949`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:00.484907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8f5a3515-9978-4a53-b250-79288685c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:00.655572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1128/2212] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:00.713407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:00.715150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:00.803480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8da1a6-3460-41c6-b73f-a523370257b1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:00.808054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:00.808835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:00.809117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:00.809392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:00.818823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:00.820329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:00.830439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1085/2213] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:19:02.478143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87ea8-245c-41fb-b9fc-7e547bc5a3be None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:02.479024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87ea8-245c-41fb-b9fc-7e547bc5a3be None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:02.479024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87ea8-245c-41fb-b9fc-7e547bc5a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:02.499575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-31c87ea8-245c-41fb-b9fc-7e547bc5a3be None None] MFA Rules not processed for user `2395b5604780462a87c9da3bcf620949`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:02.500898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-31c87ea8-245c-41fb-b9fc-7e547bc5a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:02.508375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1129/2214] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:02.918258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:02.919766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:02.948272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87ea8-245c-41fb-b9fc-7e547bc5a3be None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:02.950081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-31c87ea8-245c-41fb-b9fc-7e547bc5a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:02.968066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87ea8-245c-41fb-b9fc-7e547bc5a3be None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:02.983491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8c178-c048-4832-8d21-8918eef08682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:02.984247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c178-c048-4832-8d21-8918eef08682 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:02.984507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c178-c048-4832-8d21-8918eef08682 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:02.984786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8c178-c048-4832-8d21-8918eef08682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:02.987980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-22b8c178-c048-4832-8d21-8918eef08682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:03.030013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:03.070272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba3d8d-6403-40d9-aa18-758a58c0635d service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:03.080951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:03.081856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:03.082133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:03.085286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] PATH_INFO: `/v3/users/d3038ea5d7724f469a8037208faee10d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:03.089361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3038ea5d7724f469a8037208faee10d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:03.098601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:03.116137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8c178-c048-4832-8d21-8918eef08682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:03.119378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8c178-c048-4832-8d21-8918eef08682 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:03.143004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1130/2215] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:03.228413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:03.245001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3038ea5d7724f469a8037208faee10d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:03.245810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3038ea5d7724f469a8037208faee10d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:03.283958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3038ea5d7724f469a8037208faee10d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:03.284905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3038ea5d7724f469a8037208faee10d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:03.299664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3038ea5d7724f469a8037208faee10d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:03.330983 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1086/2216] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:02 2022] DELETE /identity/v3/users/d3038ea5d7724f469a8037208faee10d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:03.332690 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae896b1-081c-406e-8888-511c2711beca None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:03.333040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae896b1-081c-406e-8888-511c2711beca None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:03.333328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae896b1-081c-406e-8888-511c2711beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:03.373274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8ae896b1-081c-406e-8888-511c2711beca None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:03.373274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8ae896b1-081c-406e-8888-511c2711beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:03.517978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1131/2217] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:03.546156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:03.548789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:03.661976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93293-5889-49f4-826f-35c481328365 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:03.668097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475647b3-b4a0-470c-accd-3681fd04eaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:03.668907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475647b3-b4a0-470c-accd-3681fd04eaaa service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:03.669218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475647b3-b4a0-470c-accd-3681fd04eaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:03.669468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475647b3-b4a0-470c-accd-3681fd04eaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:03.682169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475647b3-b4a0-470c-accd-3681fd04eaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:03.684307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475647b3-b4a0-470c-accd-3681fd04eaaa service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:03.708630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1087/2218] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:04.271077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae896b1-081c-406e-8888-511c2711beca None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:04.275246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8ae896b1-081c-406e-8888-511c2711beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:04.333846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae896b1-081c-406e-8888-511c2711beca None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:04.370391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:04.371909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:04.372407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:04.372819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] PATH_INFO: `/v3/projects/0f41cb04aea94aec9d5014f97c4d7b1d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:04.377239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f41cb04aea94aec9d5014f97c4d7b1d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:04.383564 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:04.602758 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f41cb04aea94aec9d5014f97c4d7b1d', 'request_id': 'req-90e685aa-a7b6-4513-860c-1474d15e1c05'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.607914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f41cb04aea94aec9d5014f97c4d7b1d', 'request_id': 'req-90e685aa-a7b6-4513-860c-1474d15e1c05'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.619830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f41cb04aea94aec9d5014f97c4d7b1d', 'request_id': 'req-90e685aa-a7b6-4513-860c-1474d15e1c05'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.643182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] The token cache is being invalidate because project 0f41cb04aea94aec9d5014f97c4d7b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:04.643812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.645550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.650472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1132/2219] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:04 2022] DELETE /identity/v3/projects/0f41cb04aea94aec9d5014f97c4d7b1d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:04.654631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475647b3-b4a0-470c-accd-3681fd04eaaa service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:04.667170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475647b3-b4a0-470c-accd-3681fd04eaaa service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:04.757344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:04.757344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:04.757873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:04.758098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] PATH_INFO: `/v3/users/13f440b86f7d4ec3ac15dbb3f3f8c82c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:04.760150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f440b86f7d4ec3ac15dbb3f3f8c82c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:04.762900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:04.848447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f440b86f7d4ec3ac15dbb3f3f8c82c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.848959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f440b86f7d4ec3ac15dbb3f3f8c82c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.879503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f440b86f7d4ec3ac15dbb3f3f8c82c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.883061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f440b86f7d4ec3ac15dbb3f3f8c82c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.888694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:04.901886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6013b370-549e-4481-bfad-a9aa5d782997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f440b86f7d4ec3ac15dbb3f3f8c82c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:04.938007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1088/2220] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:04 2022] DELETE /identity/v3/users/13f440b86f7d4ec3ac15dbb3f3f8c82c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:05.641559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:05.646565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:05.711609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e685aa-a7b6-4513-860c-1474d15e1c05 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:05.828771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:05.852025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:05.854221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:05.854675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:05.855160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] PATH_INFO: `/v3/projects/958bbbb4531544569cb2080716c8a635` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:05.856553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=958bbbb4531544569cb2080716c8a635)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:05.859413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:05.938359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958bbbb4531544569cb2080716c8a635', 'request_id': 'req-f46e22a9-19b5-4d64-87ba-4931c7a05394'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:05.956563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958bbbb4531544569cb2080716c8a635', 'request_id': 'req-f46e22a9-19b5-4d64-87ba-4931c7a05394'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:05.971053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958bbbb4531544569cb2080716c8a635', 'request_id': 'req-f46e22a9-19b5-4d64-87ba-4931c7a05394'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:05.993596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] The token cache is being invalidate because project 958bbbb4531544569cb2080716c8a635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:05.995271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:05.996654 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f46e22a9-19b5-4d64-87ba-4931c7a05394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:05.999144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1133/2221] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:05 2022] DELETE /identity/v3/projects/958bbbb4531544569cb2080716c8a635 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:06.005632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5861-14bd-40a7-91a7-01c4dd902e35 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:06.006536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5861-14bd-40a7-91a7-01c4dd902e35 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:06.006989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e5861-14bd-40a7-91a7-01c4dd902e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:06.042008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2c3e5861-14bd-40a7-91a7-01c4dd902e35 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:06.044363 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2c3e5861-14bd-40a7-91a7-01c4dd902e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:06.225960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1089/2222] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:19:06.230698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76193485-cc99-42f1-96c9-da3c56753801 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:06.231235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76193485-cc99-42f1-96c9-da3c56753801 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:06.231696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76193485-cc99-42f1-96c9-da3c56753801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:06.273314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-76193485-cc99-42f1-96c9-da3c56753801 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:06.275957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-76193485-cc99-42f1-96c9-da3c56753801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:06.309041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1134/2223] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:06.311890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e5861-14bd-40a7-91a7-01c4dd902e35 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:06.361957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e5861-14bd-40a7-91a7-01c4dd902e35 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:06.378988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:06.379562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:06.379909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:06.380792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:06.382590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:19:06.383444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:06.385563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:06.406469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1090/2224] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:19:06.409671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76193485-cc99-42f1-96c9-da3c56753801 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:06.425929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76193485-cc99-42f1-96c9-da3c56753801 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:06.435586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985c33-686b-45cc-84ac-8bc3e1d576aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:06.437107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985c33-686b-45cc-84ac-8bc3e1d576aa admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:06.437345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985c33-686b-45cc-84ac-8bc3e1d576aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:06.438803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4985c33-686b-45cc-84ac-8bc3e1d576aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:06.447798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4985c33-686b-45cc-84ac-8bc3e1d576aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:06.458451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4985c33-686b-45cc-84ac-8bc3e1d576aa admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:06.523684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1135/2225] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:06 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:06.538857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:06.566008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d065d-ab45-4cc3-8bb3-36e519466444 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:06.705715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382522ee-820e-4f3d-aa7c-05141c9a968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:06.706632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382522ee-820e-4f3d-aa7c-05141c9a968f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:06.707046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382522ee-820e-4f3d-aa7c-05141c9a968f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:06.707463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382522ee-820e-4f3d-aa7c-05141c9a968f admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:06.709688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382522ee-820e-4f3d-aa7c-05141c9a968f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:06.712914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382522ee-820e-4f3d-aa7c-05141c9a968f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:06.758619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1091/2226] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:06 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:06.763684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985c33-686b-45cc-84ac-8bc3e1d576aa admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:06.776288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4985c33-686b-45cc-84ac-8bc3e1d576aa admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:06.781655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d62c9-e9ca-4776-b226-9512fa7ac229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:06.782532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d62c9-e9ca-4776-b226-9512fa7ac229 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:06.782922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d62c9-e9ca-4776-b226-9512fa7ac229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:06.783304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d62c9-e9ca-4776-b226-9512fa7ac229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:06.784202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d62c9-e9ca-4776-b226-9512fa7ac229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:06.785987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d62c9-e9ca-4776-b226-9512fa7ac229 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:06.801578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1136/2227] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:06.806590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382522ee-820e-4f3d-aa7c-05141c9a968f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:06.823306 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382522ee-820e-4f3d-aa7c-05141c9a968f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:06.830297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c14354-639a-4158-bdd3-1c93ea4ab706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:06.831026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14354-639a-4158-bdd3-1c93ea4ab706 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:06.831309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14354-639a-4158-bdd3-1c93ea4ab706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:06.831585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14354-639a-4158-bdd3-1c93ea4ab706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:06.832477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c14354-639a-4158-bdd3-1c93ea4ab706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:06.834053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c14354-639a-4158-bdd3-1c93ea4ab706 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:06.863259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1092/2228] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:19:06.869714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d62c9-e9ca-4776-b226-9512fa7ac229 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:06.911881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d62c9-e9ca-4776-b226-9512fa7ac229 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:06.932278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:06.934253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:06.935073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:06.935505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] PATH_INFO: `/v3/projects/7b3c093e00a944a38eec97a23a1232b3/users/036fb7ef2a80446d823b96d477b697f1/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:06.971857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3c093e00a944a38eec97a23a1232b3, user_id=036fb7ef2a80446d823b96d477b697f1, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:06.980498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:07.032176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1137/2229] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:06 2022] PUT /identity/v3/projects/7b3c093e00a944a38eec97a23a1232b3/users/036fb7ef2a80446d823b96d477b697f1/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:07.049778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0a30-1be1-47a9-9c63-e0c9dad17fa0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:07.051190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0a30-1be1-47a9-9c63-e0c9dad17fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:07.052002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b0a30-1be1-47a9-9c63-e0c9dad17fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:07.111569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-554b0a30-1be1-47a9-9c63-e0c9dad17fa0 None None] MFA Rules not processed for user `036fb7ef2a80446d823b96d477b697f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:07.113564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-554b0a30-1be1-47a9-9c63-e0c9dad17fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:07.268358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:07.327783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1093/2230] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:19:07.353222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:07.355909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:07.482548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c0900-6ea0-4e4b-8f50-e5466bf03ca9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:07.494260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:07.495128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:07.495415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:07.495694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:07.517333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:07.518042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:07.565004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1138/2231] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:09.026687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b0a30-1be1-47a9-9c63-e0c9dad17fa0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:09.028606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-554b0a30-1be1-47a9-9c63-e0c9dad17fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:09.154583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:09.156990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:09.224318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:09.282130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b0a30-1be1-47a9-9c63-e0c9dad17fa0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:09.294458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:09.295404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:09.297534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:09.297922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] PATH_INFO: `/v3/users/2696ca1dde664bd88abc592052b6e88f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:09.300215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2696ca1dde664bd88abc592052b6e88f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:09.303897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:09.382951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63017ea-ce14-4ae6-a400-92bc228cb63f service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:09.410261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:09.412341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:09.413890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:09.414489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] PATH_INFO: `/v3/users/c2802dc1edb54153ad2c0e2751563489` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:09.419307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2802dc1edb54153ad2c0e2751563489)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:09.425468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:09.429510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2696ca1dde664bd88abc592052b6e88f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.430789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2696ca1dde664bd88abc592052b6e88f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.466792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2696ca1dde664bd88abc592052b6e88f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.468411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2696ca1dde664bd88abc592052b6e88f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.500942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b97ae057-ba6b-4287-8b9a-0f3a31b50f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2696ca1dde664bd88abc592052b6e88f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.532348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1094/2232] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:09 2022] DELETE /identity/v3/users/2696ca1dde664bd88abc592052b6e88f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:09.540974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751575-d65f-4e42-9830-3b85d059903e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:09.541921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751575-d65f-4e42-9830-3b85d059903e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:09.542504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751575-d65f-4e42-9830-3b85d059903e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:09.621693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ef751575-d65f-4e42-9830-3b85d059903e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:09.621693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ef751575-d65f-4e42-9830-3b85d059903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:09.648841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2802dc1edb54153ad2c0e2751563489'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.654744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2802dc1edb54153ad2c0e2751563489'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.681034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2802dc1edb54153ad2c0e2751563489'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.721253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2802dc1edb54153ad2c0e2751563489'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.722402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2802dc1edb54153ad2c0e2751563489'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:09.754373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1139/2233] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:09 2022] DELETE /identity/v3/users/c2802dc1edb54153ad2c0e2751563489 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:09.759463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:09.820442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1095/2234] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:09.863408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:09.884001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:10.044596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9599a7d-e545-450f-abdc-1ce26b4caa0e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:10.052193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d5d47-7868-4bce-9c02-1952fc35c04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:10.053666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d5d47-7868-4bce-9c02-1952fc35c04c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.055165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d5d47-7868-4bce-9c02-1952fc35c04c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.056947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d5d47-7868-4bce-9c02-1952fc35c04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.170641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef751575-d65f-4e42-9830-3b85d059903e None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:10.172846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ef751575-d65f-4e42-9830-3b85d059903e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:10.178290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:10.199931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef751575-d65f-4e42-9830-3b85d059903e None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:10.214918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:10.216248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.218942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.219661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] PATH_INFO: `/v3/projects/774544813e74450f89e01104db354406` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.221509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d5d47-7868-4bce-9c02-1952fc35c04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:10.223495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=774544813e74450f89e01104db354406)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:10.225531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:10.228874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d5d47-7868-4bce-9c02-1952fc35c04c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:10.251002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1140/2235] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:10.312634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774544813e74450f89e01104db354406', 'request_id': 'req-c5a920ba-b852-486d-b89c-ce555b885c2f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.321038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774544813e74450f89e01104db354406', 'request_id': 'req-c5a920ba-b852-486d-b89c-ce555b885c2f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.331207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774544813e74450f89e01104db354406', 'request_id': 'req-c5a920ba-b852-486d-b89c-ce555b885c2f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.351977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] The token cache is being invalidate because project 774544813e74450f89e01104db354406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:10.353349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.354690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c5a920ba-b852-486d-b89c-ce555b885c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.357259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1096/2236] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:10 2022] DELETE /identity/v3/projects/774544813e74450f89e01104db354406 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:10.363693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a7b6-3057-4069-9e40-42b762f6020e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.364189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a7b6-3057-4069-9e40-42b762f6020e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.364610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6a7b6-3057-4069-9e40-42b762f6020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.394895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2ca6a7b6-3057-4069-9e40-42b762f6020e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:10.396789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2ca6a7b6-3057-4069-9e40-42b762f6020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:10.522945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1141/2237] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:10.535035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26eda-0181-4bc2-b0e6-aa36e7c68765 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.535900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26eda-0181-4bc2-b0e6-aa36e7c68765 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.535900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d26eda-0181-4bc2-b0e6-aa36e7c68765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.558372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-59d26eda-0181-4bc2-b0e6-aa36e7c68765 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:10.560237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-59d26eda-0181-4bc2-b0e6-aa36e7c68765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:10.576260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1097/2238] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:19:10.579774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6a7b6-3057-4069-9e40-42b762f6020e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:10.591295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6a7b6-3057-4069-9e40-42b762f6020e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:10.599139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:10.599951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.600322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.600716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.601582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:19:10.601920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:10.607075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:10.620187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1142/2239] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:19:10.627686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26eda-0181-4bc2-b0e6-aa36e7c68765 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:10.647602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:10.647602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:10.653463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d26eda-0181-4bc2-b0e6-aa36e7c68765 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:10.666095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993f18f-1a58-484a-b8aa-587312ef1209 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:10.668926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c69d3-718d-449a-86a9-1ddcfa3b991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:10.670172 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c69d3-718d-449a-86a9-1ddcfa3b991c admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.670583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c69d3-718d-449a-86a9-1ddcfa3b991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.671110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c69d3-718d-449a-86a9-1ddcfa3b991c admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.672769 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c69d3-718d-449a-86a9-1ddcfa3b991c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:10.674838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:10.675559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c69d3-718d-449a-86a9-1ddcfa3b991c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:10.676024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.676866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.677284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] PATH_INFO: `/v3/projects/2658d953b5ba4c758ec590aa4735ccb5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.679044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2658d953b5ba4c758ec590aa4735ccb5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:10.681492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:10.728957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1098/2240] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:10 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:19:10.733644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c69d3-718d-449a-86a9-1ddcfa3b991c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:10.763579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2658d953b5ba4c758ec590aa4735ccb5', 'request_id': 'req-b96d56e9-7e0a-4e08-9259-997ad5e7890d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.773181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2658d953b5ba4c758ec590aa4735ccb5', 'request_id': 'req-b96d56e9-7e0a-4e08-9259-997ad5e7890d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.795761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2658d953b5ba4c758ec590aa4735ccb5', 'request_id': 'req-b96d56e9-7e0a-4e08-9259-997ad5e7890d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.814486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] The token cache is being invalidate because project 2658d953b5ba4c758ec590aa4735ccb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:10.814775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.815524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:10.817659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1143/2241] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:10 2022] DELETE /identity/v3/projects/2658d953b5ba4c758ec590aa4735ccb5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:10.823923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:10.825745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:10.852702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c69d3-718d-449a-86a9-1ddcfa3b991c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:10.919105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:10.925037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d56e9-7e0a-4e08-9259-997ad5e7890d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:10.936809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:10.940889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.941432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.942618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] PATH_INFO: `/v3/users/1fcc6ec5d9304226b3439760428a7a60` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.944539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fcc6ec5d9304226b3439760428a7a60)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:10.947552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:10.962355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:10.963048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:10.963349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:10.963621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:10.964337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:10.966815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:10.975712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:11.002819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1099/2242] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:10 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:19:11.009442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:11.011581 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:11.032044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb274e-a2d5-4847-a18e-4659f8f946a6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:11.038316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:11.039411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:11.040456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:11.040969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:11.041824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:11.042383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fcc6ec5d9304226b3439760428a7a60'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.043183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fcc6ec5d9304226b3439760428a7a60'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.043905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:11.054714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fcc6ec5d9304226b3439760428a7a60'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.061369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1100/2243] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:11.066932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:11.067848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fcc6ec5d9304226b3439760428a7a60'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.068838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:11.068958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fcc6ec5d9304226b3439760428a7a60'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.088665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa534b-a7f2-417b-aa0c-3920251e5800 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:11.099463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7cc2e-1782-4b69-8638-5cc2908bbc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:11.103816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1144/2244] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:10 2022] DELETE /identity/v3/users/1fcc6ec5d9304226b3439760428a7a60 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:11.104638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7cc2e-1782-4b69-8638-5cc2908bbc7b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:11.104926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7cc2e-1782-4b69-8638-5cc2908bbc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:11.105215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7cc2e-1782-4b69-8638-5cc2908bbc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:11.106191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7cc2e-1782-4b69-8638-5cc2908bbc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:11.108253 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7cc2e-1782-4b69-8638-5cc2908bbc7b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:11.141334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1101/2245] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:19:11.142651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:11.267295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d71651-4d65-4e2b-a9f8-30c8bb8043d3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:11.295978 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:11.296982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:11.297272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:11.297551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] PATH_INFO: `/v3/projects/4185d145c1a24e95abf745f3b3f3d4e1/users/f55c9792e2fe46cc9fc86d4c0f38f4fd/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:11.337231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4185d145c1a24e95abf745f3b3f3d4e1, user_id=f55c9792e2fe46cc9fc86d4c0f38f4fd, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:11.341379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:11.365080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1145/2246] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:11 2022] PUT /identity/v3/projects/4185d145c1a24e95abf745f3b3f3d4e1/users/f55c9792e2fe46cc9fc86d4c0f38f4fd/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:11.368913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3264-ebac-40b4-8331-25090d31387b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:11.369524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3264-ebac-40b4-8331-25090d31387b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:11.369941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3264-ebac-40b4-8331-25090d31387b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:11.391348 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5dce3264-ebac-40b4-8331-25090d31387b None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:11.392663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5dce3264-ebac-40b4-8331-25090d31387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:11.513335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1102/2247] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:11.541948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:11.544216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:11.617947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca2aa6-027c-4a35-b636-a8bfb11407ff admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:11.625852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce3264-ebac-40b4-8331-25090d31387b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:11.628414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5dce3264-ebac-40b4-8331-25090d31387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:11.628572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5d01c-f490-4db7-9ba7-ae09c2d27b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:11.629921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5d01c-f490-4db7-9ba7-ae09c2d27b82 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:11.630437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5d01c-f490-4db7-9ba7-ae09c2d27b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:11.630947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5d01c-f490-4db7-9ba7-ae09c2d27b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:11.652723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5d01c-f490-4db7-9ba7-ae09c2d27b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:11.652961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce3264-ebac-40b4-8331-25090d31387b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:11.654486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5d01c-f490-4db7-9ba7-ae09c2d27b82 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:11.659162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:11.660420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:11.660815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:11.661276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] PATH_INFO: `/v3/projects/360631c763ce46baac8cf1b58a37ca83` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:11.663038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=360631c763ce46baac8cf1b58a37ca83)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:11.666497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:11.671628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1146/2248] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:11.747789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '360631c763ce46baac8cf1b58a37ca83', 'request_id': 'req-05bbba72-c46f-42ca-b16f-9124c182e17c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.757514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '360631c763ce46baac8cf1b58a37ca83', 'request_id': 'req-05bbba72-c46f-42ca-b16f-9124c182e17c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.769508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '360631c763ce46baac8cf1b58a37ca83', 'request_id': 'req-05bbba72-c46f-42ca-b16f-9124c182e17c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.792441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] The token cache is being invalidate because project 360631c763ce46baac8cf1b58a37ca83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:11.792967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.794062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05bbba72-c46f-42ca-b16f-9124c182e17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:11.797260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1103/2249] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:11 2022] DELETE /identity/v3/projects/360631c763ce46baac8cf1b58a37ca83 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:11.806026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f905a3-50ec-48e8-b8a9-a5a77feb0610 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:11.807410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f905a3-50ec-48e8-b8a9-a5a77feb0610 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:11.809724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f905a3-50ec-48e8-b8a9-a5a77feb0610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:11.819267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:11.845599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-07f905a3-50ec-48e8-b8a9-a5a77feb0610 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:11.847228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-07f905a3-50ec-48e8-b8a9-a5a77feb0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:11.971689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1147/2250] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:11.984290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21702d2f-2cda-414c-a99d-3916595295ec None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:11.984971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21702d2f-2cda-414c-a99d-3916595295ec None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:11.985415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21702d2f-2cda-414c-a99d-3916595295ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:12.032024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-21702d2f-2cda-414c-a99d-3916595295ec None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:12.035763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-21702d2f-2cda-414c-a99d-3916595295ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:12.050337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1104/2251] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:12.054982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f905a3-50ec-48e8-b8a9-a5a77feb0610 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:12.067112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f905a3-50ec-48e8-b8a9-a5a77feb0610 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:12.081168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:12.082064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:12.082539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:12.083199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:12.084147 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:19:12.084646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:12.087804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:12.107705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1148/2252] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:19:12.112795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21702d2f-2cda-414c-a99d-3916595295ec None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:12.123710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21702d2f-2cda-414c-a99d-3916595295ec None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:12.129562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcec6-5030-4ba3-88c8-00cb9987bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:12.130607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcec6-5030-4ba3-88c8-00cb9987bdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:12.130813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcec6-5030-4ba3-88c8-00cb9987bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:12.131077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcec6-5030-4ba3-88c8-00cb9987bdf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:12.132167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbcec6-5030-4ba3-88c8-00cb9987bdf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:12.133906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbcec6-5030-4ba3-88c8-00cb9987bdf1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:12.180221 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1105/2253] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:12 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:19:12.185410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:12.198879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c5304-cf1f-425d-bcc5-f6271d6b6530 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:12.295302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3195c1-00ef-40d5-a7b0-1c9b7725e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:12.296549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3195c1-00ef-40d5-a7b0-1c9b7725e655 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:12.297014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3195c1-00ef-40d5-a7b0-1c9b7725e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:12.297666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3195c1-00ef-40d5-a7b0-1c9b7725e655 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:12.299067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3195c1-00ef-40d5-a7b0-1c9b7725e655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:12.301913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3195c1-00ef-40d5-a7b0-1c9b7725e655 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:12.330610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1149/2254] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:12 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:12.335608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcec6-5030-4ba3-88c8-00cb9987bdf1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:12.353442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcec6-5030-4ba3-88c8-00cb9987bdf1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:12.360777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10104516-f656-4af2-994d-160c5120dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:12.361840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104516-f656-4af2-994d-160c5120dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:12.362130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104516-f656-4af2-994d-160c5120dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:12.362411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104516-f656-4af2-994d-160c5120dc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:12.363462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10104516-f656-4af2-994d-160c5120dc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:12.365214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10104516-f656-4af2-994d-160c5120dc00 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:12.387833 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1106/2255] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:12.394203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3195c1-00ef-40d5-a7b0-1c9b7725e655 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:12.413973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3195c1-00ef-40d5-a7b0-1c9b7725e655 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:12.420373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5895f5-c48c-44be-b47c-aa646c088dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:12.421227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5895f5-c48c-44be-b47c-aa646c088dca admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:12.431352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5895f5-c48c-44be-b47c-aa646c088dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:12.431705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5895f5-c48c-44be-b47c-aa646c088dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:12.432665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5895f5-c48c-44be-b47c-aa646c088dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:12.434210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5895f5-c48c-44be-b47c-aa646c088dca admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:12.479295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1150/2256] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:19:12.481582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10104516-f656-4af2-994d-160c5120dc00 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:12.502929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10104516-f656-4af2-994d-160c5120dc00 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:12.524825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:12.525789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:12.526070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:12.526354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] PATH_INFO: `/v3/projects/4c9891dfde3d426a8e2c4e5403162d40/users/a98d1593a2864354963f761d71e89510/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:12.552693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:12.570389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c9891dfde3d426a8e2c4e5403162d40, user_id=a98d1593a2864354963f761d71e89510, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:12.574205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:12.591659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1107/2257] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:12 2022] PUT /identity/v3/projects/4c9891dfde3d426a8e2c4e5403162d40/users/a98d1593a2864354963f761d71e89510/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:12.604848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e26e-61f2-413d-af3c-22f2baf7d8a3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:12.605296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e26e-61f2-413d-af3c-22f2baf7d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:12.605768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41e26e-61f2-413d-af3c-22f2baf7d8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:12.645198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-db41e26e-61f2-413d-af3c-22f2baf7d8a3 None None] MFA Rules not processed for user `a98d1593a2864354963f761d71e89510`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:12.647076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-db41e26e-61f2-413d-af3c-22f2baf7d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:12.734980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:12.752580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1151/2258] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:12.778736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:12.781731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:12.957735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43b08b-d081-4dd1-8976-489d7ce58313 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:12.967321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84607c-2acf-4680-a747-8897c83652c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:12.969675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84607c-2acf-4680-a747-8897c83652c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:12.969675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84607c-2acf-4680-a747-8897c83652c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:12.970036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84607c-2acf-4680-a747-8897c83652c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:13.000845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84607c-2acf-4680-a747-8897c83652c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:13.004492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84607c-2acf-4680-a747-8897c83652c6 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:13.026404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1108/2259] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:13.057346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41e26e-61f2-413d-af3c-22f2baf7d8a3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:13.181483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41e26e-61f2-413d-af3c-22f2baf7d8a3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:13.190460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:13.193738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:13.194571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:13.195527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] PATH_INFO: `/v3/users/a98d1593a2864354963f761d71e89510` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:13.209190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98d1593a2864354963f761d71e89510)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:13.212750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:13.343237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98d1593a2864354963f761d71e89510'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:13.344545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98d1593a2864354963f761d71e89510'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:13.362158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98d1593a2864354963f761d71e89510'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:13.375777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98d1593a2864354963f761d71e89510'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:13.376959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98d1593a2864354963f761d71e89510'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:13.407534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1152/2260] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:13 2022] DELETE /identity/v3/users/a98d1593a2864354963f761d71e89510 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:13.423843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a914b4-8192-4011-a500-da18d4e47861 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:13.425057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a914b4-8192-4011-a500-da18d4e47861 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:13.425057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a914b4-8192-4011-a500-da18d4e47861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:13.484671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e2a914b4-8192-4011-a500-da18d4e47861 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:13.491252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e2a914b4-8192-4011-a500-da18d4e47861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:13.627679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:13.630606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:13.740461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1109/2261] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:13.768599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a914b4-8192-4011-a500-da18d4e47861 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:13.776720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e2a914b4-8192-4011-a500-da18d4e47861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:13.879097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661a94-9e93-45d7-aeda-82477de4c5d7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:13.892767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:13.895425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:13.895883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:13.896379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] PATH_INFO: `/v3/users/036fb7ef2a80446d823b96d477b697f1` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:13.898520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036fb7ef2a80446d823b96d477b697f1)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:13.904318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:14.009862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:14.116062 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036fb7ef2a80446d823b96d477b697f1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:14.116994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a914b4-8192-4011-a500-da18d4e47861 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:14.117118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036fb7ef2a80446d823b96d477b697f1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:14.127020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:14.128842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:14.129356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:14.130032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:14.144979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036fb7ef2a80446d823b96d477b697f1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:14.158530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036fb7ef2a80446d823b96d477b697f1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:14.160536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b21da50-5282-45ba-98ad-1efdd1a34a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036fb7ef2a80446d823b96d477b697f1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:14.160735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:14.195898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1153/2262] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:13 2022] DELETE /identity/v3/users/036fb7ef2a80446d823b96d477b697f1 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:14.203214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932100c-7dbc-4dba-a259-4de8b476cd56 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:14.203508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932100c-7dbc-4dba-a259-4de8b476cd56 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:14.204094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932100c-7dbc-4dba-a259-4de8b476cd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:14.208340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:14.213381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:14.232518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2932100c-7dbc-4dba-a259-4de8b476cd56 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:14.237459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2932100c-7dbc-4dba-a259-4de8b476cd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:14.238063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1110/2263] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:14.418410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1154/2264] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:19:14.435589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:14.442186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:14.467438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7ee6a-924b-4689-a51a-7c527adce220 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:14.558659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:14.633154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:14.635012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:14.635593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:14.636087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:14.695093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:14.696859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:14.726772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1111/2265] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:14.835015 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932100c-7dbc-4dba-a259-4de8b476cd56 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:14.836801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2932100c-7dbc-4dba-a259-4de8b476cd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:14.858286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932100c-7dbc-4dba-a259-4de8b476cd56 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:14.864585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:14.865911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:14.866794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:14.867168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] PATH_INFO: `/v3/users/046e25a0bb8b48869cd7a80ea457f122` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:14.869462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046e25a0bb8b48869cd7a80ea457f122)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:14.871747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:14.967884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:14.972243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:14.985335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046e25a0bb8b48869cd7a80ea457f122'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:14.986217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046e25a0bb8b48869cd7a80ea457f122'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.002628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046e25a0bb8b48869cd7a80ea457f122'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.005927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa029-36ad-45f1-9f31-7fba47e872e4 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:15.013929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:15.017035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.017035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.017035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] PATH_INFO: `/v3/projects/4c9891dfde3d426a8e2c4e5403162d40` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.018742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c9891dfde3d426a8e2c4e5403162d40)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:15.020878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:15.035185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046e25a0bb8b48869cd7a80ea457f122'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.038222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0d6e01d-3125-4fe9-bacc-3ca7d315d5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046e25a0bb8b48869cd7a80ea457f122'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.073250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1155/2266] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:14 2022] DELETE /identity/v3/users/046e25a0bb8b48869cd7a80ea457f122 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:15.083731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2d07e-9f2e-4b0c-b49c-d12b0ccda916 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.084244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2d07e-9f2e-4b0c-b49c-d12b0ccda916 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.084539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2d07e-9f2e-4b0c-b49c-d12b0ccda916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.139207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-58a2d07e-9f2e-4b0c-b49c-d12b0ccda916 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:15.140757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-58a2d07e-9f2e-4b0c-b49c-d12b0ccda916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:15.142938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c9891dfde3d426a8e2c4e5403162d40', 'request_id': 'req-1725daac-504b-4627-9595-3d7a06a13e31'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.147528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:15.151326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c9891dfde3d426a8e2c4e5403162d40', 'request_id': 'req-1725daac-504b-4627-9595-3d7a06a13e31'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.176743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c9891dfde3d426a8e2c4e5403162d40', 'request_id': 'req-1725daac-504b-4627-9595-3d7a06a13e31'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.203931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] The token cache is being invalidate because project 4c9891dfde3d426a8e2c4e5403162d40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:15.204593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.205404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1725daac-504b-4627-9595-3d7a06a13e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.207629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1112/2267] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:14 2022] DELETE /identity/v3/projects/4c9891dfde3d426a8e2c4e5403162d40 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:15.214183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40a9cf-1584-478a-b8e1-2f7c654dceef None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.215720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40a9cf-1584-478a-b8e1-2f7c654dceef None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.216337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40a9cf-1584-478a-b8e1-2f7c654dceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.261780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9d40a9cf-1584-478a-b8e1-2f7c654dceef None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:15.264419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9d40a9cf-1584-478a-b8e1-2f7c654dceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:15.286115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1156/2268] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:15.305444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2d07e-9f2e-4b0c-b49c-d12b0ccda916 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:15.309393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-58a2d07e-9f2e-4b0c-b49c-d12b0ccda916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:15.397655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2d07e-9f2e-4b0c-b49c-d12b0ccda916 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:15.410047 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc4442-8aa1-4828-8f4b-6bc90245214d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:15.410747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc4442-8aa1-4828-8f4b-6bc90245214d service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.411035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc4442-8aa1-4828-8f4b-6bc90245214d service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.411450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc4442-8aa1-4828-8f4b-6bc90245214d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.438981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc4442-8aa1-4828-8f4b-6bc90245214d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:15.440675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc4442-8aa1-4828-8f4b-6bc90245214d service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:15.465619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1157/2269] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:15.487525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1113/2270] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:15.495782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a30ca-66fa-4a7c-b58c-573be772df84 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.496339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a30ca-66fa-4a7c-b58c-573be772df84 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.497041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a30ca-66fa-4a7c-b58c-573be772df84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.566268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-784a30ca-66fa-4a7c-b58c-573be772df84 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:15.567563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-784a30ca-66fa-4a7c-b58c-573be772df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:15.583951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1158/2271] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:15.585934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40a9cf-1584-478a-b8e1-2f7c654dceef None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:15.597588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a30ca-66fa-4a7c-b58c-573be772df84 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:15.599358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-784a30ca-66fa-4a7c-b58c-573be772df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:15.608682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40a9cf-1584-478a-b8e1-2f7c654dceef None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:15.622625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a30ca-66fa-4a7c-b58c-573be772df84 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:15.623823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:15.624559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.624893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.625100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.625858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:19:15.626662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:15.627928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:15.639511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:15.640600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.640991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.641170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] PATH_INFO: `/v3/projects/7b3c093e00a944a38eec97a23a1232b3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.642531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3c093e00a944a38eec97a23a1232b3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:15.648167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1114/2272] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:19:15.648378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:15.649831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:15.663072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e6b29-418c-4354-9ff4-6625c9388841 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:15.669837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56955df-ea52-4f15-b964-8505c5230d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:15.670528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56955df-ea52-4f15-b964-8505c5230d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.670814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56955df-ea52-4f15-b964-8505c5230d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.671117 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56955df-ea52-4f15-b964-8505c5230d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.671892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56955df-ea52-4f15-b964-8505c5230d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:15.673893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56955df-ea52-4f15-b964-8505c5230d26 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:15.734427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1115/2273] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:15 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:19:15.738100 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56955df-ea52-4f15-b964-8505c5230d26 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:15.739942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3c093e00a944a38eec97a23a1232b3', 'request_id': 'req-023466c1-4743-42f4-8f19-9d17a7f18537'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.762481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3c093e00a944a38eec97a23a1232b3', 'request_id': 'req-023466c1-4743-42f4-8f19-9d17a7f18537'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.780805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3c093e00a944a38eec97a23a1232b3', 'request_id': 'req-023466c1-4743-42f4-8f19-9d17a7f18537'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.791041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:15.812817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] The token cache is being invalidate because project 7b3c093e00a944a38eec97a23a1232b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:15.813134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.816697 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:15.819784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1159/2274] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:15 2022] DELETE /identity/v3/projects/7b3c093e00a944a38eec97a23a1232b3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:15.860033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56955df-ea52-4f15-b964-8505c5230d26 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:15.866770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175e0f9-6b1d-4276-9186-d2798e99f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:15.867480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175e0f9-6b1d-4276-9186-d2798e99f0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:15.868404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175e0f9-6b1d-4276-9186-d2798e99f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:15.868770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175e0f9-6b1d-4276-9186-d2798e99f0bc admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:15.870128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175e0f9-6b1d-4276-9186-d2798e99f0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:15.874067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175e0f9-6b1d-4276-9186-d2798e99f0bc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:15.926277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1116/2275] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:15 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:19:15.928886 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:15.931056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:16.042079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:16.119051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023466c1-4743-42f4-8f19-9d17a7f18537 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:16.128031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a80e0-62c4-471f-9e2a-53641c99f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:16.128395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a80e0-62c4-471f-9e2a-53641c99f5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:16.128648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a80e0-62c4-471f-9e2a-53641c99f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:16.129078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a80e0-62c4-471f-9e2a-53641c99f5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:16.130505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a80e0-62c4-471f-9e2a-53641c99f5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:16.132618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a80e0-62c4-471f-9e2a-53641c99f5ac admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:16.150562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1160/2276] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:16.155165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175e0f9-6b1d-4276-9186-d2798e99f0bc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:16.172028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175e0f9-6b1d-4276-9186-d2798e99f0bc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:16.178223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002a1d2-f2e3-4994-841a-cbdcce217e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:16.178949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a1d2-f2e3-4994-841a-cbdcce217e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:16.179238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a1d2-f2e3-4994-841a-cbdcce217e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:16.179551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a1d2-f2e3-4994-841a-cbdcce217e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:16.180485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002a1d2-f2e3-4994-841a-cbdcce217e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:16.182637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002a1d2-f2e3-4994-841a-cbdcce217e0f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:16.194601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1117/2277] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:16.200954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a80e0-62c4-471f-9e2a-53641c99f5ac admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:16.215751 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a80e0-62c4-471f-9e2a-53641c99f5ac admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:16.224422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:16.224968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:16.225367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:16.226438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] PATH_INFO: `/v3/projects/0f855195b0244a3881f8571c203c8e2c/users/5dba6e6488d74a779be642f1a3f0cc0d/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:16.280874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f855195b0244a3881f8571c203c8e2c, user_id=5dba6e6488d74a779be642f1a3f0cc0d, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:16.286142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:16.332744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1161/2278] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:16 2022] PUT /identity/v3/projects/0f855195b0244a3881f8571c203c8e2c/users/5dba6e6488d74a779be642f1a3f0cc0d/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:16.333501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d5fb-6c2f-4556-87e7-f1fd018cfd8c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:16.333819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d5fb-6c2f-4556-87e7-f1fd018cfd8c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:16.335638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80d5fb-6c2f-4556-87e7-f1fd018cfd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:16.391369 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1e80d5fb-6c2f-4556-87e7-f1fd018cfd8c None None] MFA Rules not processed for user `5dba6e6488d74a779be642f1a3f0cc0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:16.394076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1e80d5fb-6c2f-4556-87e7-f1fd018cfd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:16.564096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:16.567350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:16.583280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1118/2279] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:16.597846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80d5fb-6c2f-4556-87e7-f1fd018cfd8c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:16.600334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1e80d5fb-6c2f-4556-87e7-f1fd018cfd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:16.697892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825b4d6-8965-44f0-8947-41bbdea2a564 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:16.710616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:16.712918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:16.713433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:16.713877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] PATH_INFO: `/v3/projects/d8e387a5a31e41449a0d8fd20ea30e6f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:16.716143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e387a5a31e41449a0d8fd20ea30e6f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:16.717991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:16.719756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80d5fb-6c2f-4556-87e7-f1fd018cfd8c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:16.727347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae6a28-b05a-4309-9a99-2e12a5d11177 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c97bd14230147a5bd004c71f5387098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:16.731147 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6a28-b05a-4309-9a99-2e12a5d11177 service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:16.731606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6a28-b05a-4309-9a99-2e12a5d11177 service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:16.732325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae6a28-b05a-4309-9a99-2e12a5d11177 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:16.751166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae6a28-b05a-4309-9a99-2e12a5d11177 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:16.753892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae6a28-b05a-4309-9a99-2e12a5d11177 service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:16.768977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1119/2280] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:19:16.814181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e387a5a31e41449a0d8fd20ea30e6f', 'request_id': 'req-65226dd6-a9af-4011-86d1-4726d7f9d860'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:16.823792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e387a5a31e41449a0d8fd20ea30e6f', 'request_id': 'req-65226dd6-a9af-4011-86d1-4726d7f9d860'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:16.838924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e387a5a31e41449a0d8fd20ea30e6f', 'request_id': 'req-65226dd6-a9af-4011-86d1-4726d7f9d860'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:16.859505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] The token cache is being invalidate because project d8e387a5a31e41449a0d8fd20ea30e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:16.860686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:16.862017 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65226dd6-a9af-4011-86d1-4726d7f9d860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:16.870177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1162/2281] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:16 2022] DELETE /identity/v3/projects/d8e387a5a31e41449a0d8fd20ea30e6f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:16.878509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c04c-9399-4734-bce4-fb08c4b4515c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:16.878910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c04c-9399-4734-bce4-fb08c4b4515c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:16.879247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76c04c-9399-4734-bce4-fb08c4b4515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:16.942316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2c76c04c-9399-4734-bce4-fb08c4b4515c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:16.945462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2c76c04c-9399-4734-bce4-fb08c4b4515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:17.017579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:17.054839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1120/2282] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:17.065805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4adbc5-e14e-4a36-9b37-156c216d775a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:17.067535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4adbc5-e14e-4a36-9b37-156c216d775a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:17.068459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4adbc5-e14e-4a36-9b37-156c216d775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:17.108303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3b4adbc5-e14e-4a36-9b37-156c216d775a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:17.109563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3b4adbc5-e14e-4a36-9b37-156c216d775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:17.126252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1163/2283] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:17.127068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76c04c-9399-4734-bce4-fb08c4b4515c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:17.144044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76c04c-9399-4734-bce4-fb08c4b4515c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:17.155684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:17.157127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:17.157804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:17.159054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:17.160161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:19:17.160585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:17.162415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:17.194090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4adbc5-e14e-4a36-9b37-156c216d775a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:17.201326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1121/2284] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:19:17.231839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4adbc5-e14e-4a36-9b37-156c216d775a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:17.261027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ae54b-3402-48fc-92c7-905607e0ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:17.262385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae54b-3402-48fc-92c7-905607e0ea1c admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:17.266691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae54b-3402-48fc-92c7-905607e0ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:17.270210 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ae54b-3402-48fc-92c7-905607e0ea1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:17.277113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ae54b-3402-48fc-92c7-905607e0ea1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:17.292979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ae54b-3402-48fc-92c7-905607e0ea1c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:17.355408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1164/2285] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:17 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:19:17.362178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:17.379909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79ab36-696a-4ed2-b336-b95e0d2aa2bd admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:17.608705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8c145-cef7-4d80-808c-65d209ce31f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:17.609729 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c145-cef7-4d80-808c-65d209ce31f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:17.610832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c145-cef7-4d80-808c-65d209ce31f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:17.611250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8c145-cef7-4d80-808c-65d209ce31f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:17.612738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8c145-cef7-4d80-808c-65d209ce31f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:17.618235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8c145-cef7-4d80-808c-65d209ce31f2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:17.681468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1122/2286] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:17 2022] POST /identity/v3/users => generated 286 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:17.682777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ae54b-3402-48fc-92c7-905607e0ea1c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:17.690715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:17.702956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ae54b-3402-48fc-92c7-905607e0ea1c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:17.722522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08000-b1d2-4fa1-a2c0-3d69e0527a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:17.723249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08000-b1d2-4fa1-a2c0-3d69e0527a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:17.723541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08000-b1d2-4fa1-a2c0-3d69e0527a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:17.723824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08000-b1d2-4fa1-a2c0-3d69e0527a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:17.724622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d08000-b1d2-4fa1-a2c0-3d69e0527a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:17.726405 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d08000-b1d2-4fa1-a2c0-3d69e0527a92 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:17.747662 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1165/2287] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:17.752053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8c145-cef7-4d80-808c-65d209ce31f2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:17.765718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8c145-cef7-4d80-808c-65d209ce31f2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:17.788578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488e21c-f11e-4fce-9b43-9bec28ae34f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:17.790054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e21c-f11e-4fce-9b43-9bec28ae34f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:17.790502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e21c-f11e-4fce-9b43-9bec28ae34f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:17.792753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488e21c-f11e-4fce-9b43-9bec28ae34f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:17.793779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488e21c-f11e-4fce-9b43-9bec28ae34f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:17.798120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488e21c-f11e-4fce-9b43-9bec28ae34f0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:17.836669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1123/2288] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:17.838461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08000-b1d2-4fa1-a2c0-3d69e0527a92 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:17.856695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d08000-b1d2-4fa1-a2c0-3d69e0527a92 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:17.887899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:17.891663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:17.895937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:17.896498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] PATH_INFO: `/v3/projects/60015835b513437bb4aab6c44781cdcd/users/36c428cb214a4a468768e0e94cb9b052/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:17.922952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60015835b513437bb4aab6c44781cdcd, user_id=36c428cb214a4a468768e0e94cb9b052, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:17.927135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:17.949195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1166/2289] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:17 2022] PUT /identity/v3/projects/60015835b513437bb4aab6c44781cdcd/users/36c428cb214a4a468768e0e94cb9b052/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:17.960166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcda88-862a-4286-a494-13f59d43555a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:17.960509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcda88-862a-4286-a494-13f59d43555a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:17.965812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcda88-862a-4286-a494-13f59d43555a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:18.060784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9edcda88-862a-4286-a494-13f59d43555a None None] MFA Rules not processed for user `36c428cb214a4a468768e0e94cb9b052`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:18.064138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9edcda88-862a-4286-a494-13f59d43555a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:18.166005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1124/2290] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:18.177282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:18.179114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:18.285247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f904-71ae-41ab-9e17-97e6327fefb8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:18.289508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93242d2-5d0f-48c3-a296-727e1135735a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:18.290829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93242d2-5d0f-48c3-a296-727e1135735a service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:18.291341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93242d2-5d0f-48c3-a296-727e1135735a service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:18.292011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93242d2-5d0f-48c3-a296-727e1135735a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:18.311805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93242d2-5d0f-48c3-a296-727e1135735a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:18.315769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93242d2-5d0f-48c3-a296-727e1135735a service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:18.339050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1167/2291] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:18.382236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcda88-862a-4286-a494-13f59d43555a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:18.434673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:18.493458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcda88-862a-4286-a494-13f59d43555a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:18.500812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:18.501925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:18.502272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:18.502632 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] PATH_INFO: `/v3/users/36c428cb214a4a468768e0e94cb9b052` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:18.504891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c428cb214a4a468768e0e94cb9b052)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:18.507816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:18.654708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c428cb214a4a468768e0e94cb9b052'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:18.659397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c428cb214a4a468768e0e94cb9b052'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:18.716465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c428cb214a4a468768e0e94cb9b052'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:18.717680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c428cb214a4a468768e0e94cb9b052'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:18.747663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c428cb214a4a468768e0e94cb9b052'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:18.810578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1125/2292] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:18 2022] DELETE /identity/v3/users/36c428cb214a4a468768e0e94cb9b052 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:18.816334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394dcfc-62f0-44be-95d6-6127580e59a4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:18.816936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394dcfc-62f0-44be-95d6-6127580e59a4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:18.817933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394dcfc-62f0-44be-95d6-6127580e59a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:18.850788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7394dcfc-62f0-44be-95d6-6127580e59a4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:18.853530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7394dcfc-62f0-44be-95d6-6127580e59a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:19.050593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1168/2293] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:19.070473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:19.082930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:19.246967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f71c5-2dd5-4262-a275-ecfea4583144 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:19.251148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4759565-12a6-4571-a50d-00369172ee71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:19.251813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759565-12a6-4571-a50d-00369172ee71 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:19.252122 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759565-12a6-4571-a50d-00369172ee71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:19.252407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4759565-12a6-4571-a50d-00369172ee71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:19.262432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4759565-12a6-4571-a50d-00369172ee71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:19.263908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4759565-12a6-4571-a50d-00369172ee71 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:19.281445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1126/2294] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:19.724162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394dcfc-62f0-44be-95d6-6127580e59a4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:19.725956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7394dcfc-62f0-44be-95d6-6127580e59a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:19.748396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394dcfc-62f0-44be-95d6-6127580e59a4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:19.766872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:19.767815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:19.768186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:19.768418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] PATH_INFO: `/v3/projects/60015835b513437bb4aab6c44781cdcd` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:19.769878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60015835b513437bb4aab6c44781cdcd)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:19.771894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:19.887542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60015835b513437bb4aab6c44781cdcd', 'request_id': 'req-e208aabc-43fc-4674-8ae1-97411ecbc690'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:19.902606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60015835b513437bb4aab6c44781cdcd', 'request_id': 'req-e208aabc-43fc-4674-8ae1-97411ecbc690'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:19.921216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60015835b513437bb4aab6c44781cdcd', 'request_id': 'req-e208aabc-43fc-4674-8ae1-97411ecbc690'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:19.940090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:19.950612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] The token cache is being invalidate because project 60015835b513437bb4aab6c44781cdcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:19.951313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:19.953531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e208aabc-43fc-4674-8ae1-97411ecbc690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:19.993529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1169/2295] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:19 2022] DELETE /identity/v3/projects/60015835b513437bb4aab6c44781cdcd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:19.995166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231aea0-2878-4860-ba13-b51ab222e233 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:19.995999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231aea0-2878-4860-ba13-b51ab222e233 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:19.995999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231aea0-2878-4860-ba13-b51ab222e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:19.996635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f63c-54fc-4859-a681-bb019a749adb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:19.996795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f63c-54fc-4859-a681-bb019a749adb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:19.997240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069f63c-54fc-4859-a681-bb019a749adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.024793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7069f63c-54fc-4859-a681-bb019a749adb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:20.026439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7069f63c-54fc-4859-a681-bb019a749adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:20.061576 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b231aea0-2878-4860-ba13-b51ab222e233 None None] MFA Rules not processed for user `f55c9792e2fe46cc9fc86d4c0f38f4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:20.064128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b231aea0-2878-4860-ba13-b51ab222e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:20.153850 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:20.156600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1170/2296] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:20.164833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10777d6-c133-446b-8173-a507656cf0a9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.165736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10777d6-c133-446b-8173-a507656cf0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.166073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10777d6-c133-446b-8173-a507656cf0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.197724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b10777d6-c133-446b-8173-a507656cf0a9 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:20.199094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b10777d6-c133-446b-8173-a507656cf0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:20.200092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1127/2297] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:19:20.214004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1171/2298] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:20.219684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00193-1614-4380-9368-7b7a6ee4ca75 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.219684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00193-1614-4380-9368-7b7a6ee4ca75 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.219984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c00193-1614-4380-9368-7b7a6ee4ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.221491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10777d6-c133-446b-8173-a507656cf0a9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:20.237478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10777d6-c133-446b-8173-a507656cf0a9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:20.245757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:20.246824 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.247307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.247879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.249125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:19:20.249668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:20.250079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-95c00193-1614-4380-9368-7b7a6ee4ca75 None None] MFA Rules not processed for user `f55c9792e2fe46cc9fc86d4c0f38f4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:20.256198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:20.256547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-95c00193-1614-4380-9368-7b7a6ee4ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:20.268968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1128/2299] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:19:20.287073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1172/2300] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:19:20.292686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c00193-1614-4380-9368-7b7a6ee4ca75 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:20.304549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:20.313070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:20.319498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c00193-1614-4380-9368-7b7a6ee4ca75 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:20.326793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf192-c29b-41f3-93d0-47d1c6e656b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:20.327960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf192-c29b-41f3-93d0-47d1c6e656b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.328395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf192-c29b-41f3-93d0-47d1c6e656b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.328732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf192-c29b-41f3-93d0-47d1c6e656b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.329633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf192-c29b-41f3-93d0-47d1c6e656b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:20.331885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf192-c29b-41f3-93d0-47d1c6e656b0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:20.382607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1129/2301] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:20 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:20.387517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf192-c29b-41f3-93d0-47d1c6e656b0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:20.457768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc167bd9-11ba-4de6-b1cc-2d215b10a4cd admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:20.509428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf192-c29b-41f3-93d0-47d1c6e656b0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:20.526620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c31b-5bcc-4caf-a441-e260c186ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:20.533966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c31b-5bcc-4caf-a441-e260c186ffad admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.534287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c31b-5bcc-4caf-a441-e260c186ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.534586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4c31b-5bcc-4caf-a441-e260c186ffad admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.535311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c31b-5bcc-4caf-a441-e260c186ffad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:20.537466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4c31b-5bcc-4caf-a441-e260c186ffad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:20.566996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1130/2302] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:20 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:19:20.569050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b4d8d-097e-46d6-8e33-cf91e404c9b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:20.570501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4d8d-097e-46d6-8e33-cf91e404c9b8 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.571472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4d8d-097e-46d6-8e33-cf91e404c9b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.571765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b4d8d-097e-46d6-8e33-cf91e404c9b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.572349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c31b-5bcc-4caf-a441-e260c186ffad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:20.586416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4c31b-5bcc-4caf-a441-e260c186ffad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:20.594960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:20.595828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb24ba7-8662-43db-a90d-9c2336ac05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:20.597160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb24ba7-8662-43db-a90d-9c2336ac05ad admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.597488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb24ba7-8662-43db-a90d-9c2336ac05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.597861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb24ba7-8662-43db-a90d-9c2336ac05ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.598563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb24ba7-8662-43db-a90d-9c2336ac05ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:20.600218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb24ba7-8662-43db-a90d-9c2336ac05ad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:20.623668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1131/2303] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:19:20.626413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb24ba7-8662-43db-a90d-9c2336ac05ad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:20.640682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb24ba7-8662-43db-a90d-9c2336ac05ad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:20.651385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855794-ce16-4b67-9542-92ac0354b8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:20.652319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855794-ce16-4b67-9542-92ac0354b8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.652611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855794-ce16-4b67-9542-92ac0354b8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.653049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95855794-ce16-4b67-9542-92ac0354b8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.654017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95855794-ce16-4b67-9542-92ac0354b8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:20.656023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95855794-ce16-4b67-9542-92ac0354b8fb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:20.674989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1132/2304] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:20.677207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855794-ce16-4b67-9542-92ac0354b8fb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:20.699336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95855794-ce16-4b67-9542-92ac0354b8fb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:20.707652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:20.708237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.708444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.708726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] PATH_INFO: `/v3/projects/eee43603313c41129dc2f15e85fe6cff/users/03a0cbf981614773a7bdd589b6d52a16/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.713312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b4d8d-097e-46d6-8e33-cf91e404c9b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:20.731259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee43603313c41129dc2f15e85fe6cff, user_id=03a0cbf981614773a7bdd589b6d52a16, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:20.732359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b4d8d-097e-46d6-8e33-cf91e404c9b8 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:20.736286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:20.755800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1173/2305] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:20.772271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1133/2306] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:20 2022] PUT /identity/v3/projects/eee43603313c41129dc2f15e85fe6cff/users/03a0cbf981614773a7bdd589b6d52a16/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:20.781076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdbf1-0910-4249-861c-e092f36201f7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:20.781445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdbf1-0910-4249-861c-e092f36201f7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:20.781825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdbf1-0910-4249-861c-e092f36201f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:20.830099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-faecdbf1-0910-4249-861c-e092f36201f7 None None] MFA Rules not processed for user `03a0cbf981614773a7bdd589b6d52a16`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:20.831343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-faecdbf1-0910-4249-861c-e092f36201f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:20.963530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1174/2307] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:20.976375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:20.980027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:21.063270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd8140-c19c-4d78-a014-4feee50f560c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:21.068496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726a2e8-2273-4350-b9a9-66f82c088ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:21.069331 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726a2e8-2273-4350-b9a9-66f82c088ddd service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:21.069689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726a2e8-2273-4350-b9a9-66f82c088ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:21.070053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726a2e8-2273-4350-b9a9-66f82c088ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:21.090658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726a2e8-2273-4350-b9a9-66f82c088ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:21.092440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726a2e8-2273-4350-b9a9-66f82c088ddd service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:21.110058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1134/2308] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:21.739088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c935bc9-45be-4411-974e-3b9f67ef9ac9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:21.739937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c935bc9-45be-4411-974e-3b9f67ef9ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:21.741066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c935bc9-45be-4411-974e-3b9f67ef9ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:21.765909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3c935bc9-45be-4411-974e-3b9f67ef9ac9 None None] MFA Rules not processed for user `f55c9792e2fe46cc9fc86d4c0f38f4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:21.767174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3c935bc9-45be-4411-974e-3b9f67ef9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:21.896639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1175/2309] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:26.595846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432668af-de36-4dc0-ac01-904299028ad0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:26.605783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432668af-de36-4dc0-ac01-904299028ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:26.606085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432668af-de36-4dc0-ac01-904299028ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:26.626971 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:26.661082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-432668af-de36-4dc0-ac01-904299028ad0 None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:26.662818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-432668af-de36-4dc0-ac01-904299028ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:26.800752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1135/2310] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:19:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:26.893941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c935bc9-45be-4411-974e-3b9f67ef9ac9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:26.896059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3c935bc9-45be-4411-974e-3b9f67ef9ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:27.056759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:27.106283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c935bc9-45be-4411-974e-3b9f67ef9ac9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:27.123973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a399e-c110-4d1e-84e4-da6f54f72635 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:27.124682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a399e-c110-4d1e-84e4-da6f54f72635 service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:27.124965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a399e-c110-4d1e-84e4-da6f54f72635 service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:27.125245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a399e-c110-4d1e-84e4-da6f54f72635 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:27.144658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a399e-c110-4d1e-84e4-da6f54f72635 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:27.146310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a399e-c110-4d1e-84e4-da6f54f72635 service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:27.175275 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1176/2311] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:19:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:19:28.318578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aca06-13b0-4514-ba38-afe3baefd226 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:28.319154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aca06-13b0-4514-ba38-afe3baefd226 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:28.319255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aca06-13b0-4514-ba38-afe3baefd226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:28.367672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-816aca06-13b0-4514-ba38-afe3baefd226 None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:28.369071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-816aca06-13b0-4514-ba38-afe3baefd226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:28.378240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1136/2312] 10.222.0.17 () {58 vars in 967 bytes} [Thu Jul 14 11:19:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:19:28.393311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a399e-c110-4d1e-84e4-da6f54f72635 service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:28.404722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a399e-c110-4d1e-84e4-da6f54f72635 service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:28.428339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebf7b8-2093-4a68-84fc-893b4176842d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:28.429018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf7b8-2093-4a68-84fc-893b4176842d service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:28.429305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf7b8-2093-4a68-84fc-893b4176842d service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:28.429577 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebf7b8-2093-4a68-84fc-893b4176842d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:28.446669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebf7b8-2093-4a68-84fc-893b4176842d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:28.448324 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebf7b8-2093-4a68-84fc-893b4176842d service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:28.465110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1177/2313] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:19:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:19:28.742999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e848be-e88f-4abe-82f6-985f7cac5e4e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:28.743468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e848be-e88f-4abe-82f6-985f7cac5e4e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:28.743567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e848be-e88f-4abe-82f6-985f7cac5e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:28.768767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a8e848be-e88f-4abe-82f6-985f7cac5e4e None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:28.770012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a8e848be-e88f-4abe-82f6-985f7cac5e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:28.777309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1137/2314] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:19:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:28.793187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebf7b8-2093-4a68-84fc-893b4176842d service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:28.804651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebf7b8-2093-4a68-84fc-893b4176842d service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:28.811397 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898ae58-d69d-4950-ace1-d81d0eeab07f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:28.812013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ae58-d69d-4950-ace1-d81d0eeab07f service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:28.812506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ae58-d69d-4950-ace1-d81d0eeab07f service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:28.813143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898ae58-d69d-4950-ace1-d81d0eeab07f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:28.824331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898ae58-d69d-4950-ace1-d81d0eeab07f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:28.826216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898ae58-d69d-4950-ace1-d81d0eeab07f service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:28.838551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1178/2315] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:19:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 11:19:29.246869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510a0c-31b3-4508-9a92-03f05a1c8e3b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:29.247576 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510a0c-31b3-4508-9a92-03f05a1c8e3b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:29.249116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca510a0c-31b3-4508-9a92-03f05a1c8e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:29.278797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ca510a0c-31b3-4508-9a92-03f05a1c8e3b None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:29.280008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ca510a0c-31b3-4508-9a92-03f05a1c8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:29.287713 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1138/2316] 10.222.0.17 () {58 vars in 967 bytes} [Thu Jul 14 11:19:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:19:29.308209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898ae58-d69d-4950-ace1-d81d0eeab07f service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:29.321551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898ae58-d69d-4950-ace1-d81d0eeab07f service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:29.327763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274e061-ed38-4311-817a-ce8f785b802f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:29.328638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274e061-ed38-4311-817a-ce8f785b802f service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:29.329076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274e061-ed38-4311-817a-ce8f785b802f service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:29.329523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274e061-ed38-4311-817a-ce8f785b802f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:29.352879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274e061-ed38-4311-817a-ce8f785b802f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:29.352879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274e061-ed38-4311-817a-ce8f785b802f service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:29.361700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1179/2317] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:19:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:19:31.970330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca510a0c-31b3-4508-9a92-03f05a1c8e3b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:31.971721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ca510a0c-31b3-4508-9a92-03f05a1c8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:32.040530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca510a0c-31b3-4508-9a92-03f05a1c8e3b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:32.044923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:32.045808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:32.046088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:32.046529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] PATH_INFO: `/v3/users/2395b5604780462a87c9da3bcf620949` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:32.047814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2395b5604780462a87c9da3bcf620949)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:32.049804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:32.096965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2395b5604780462a87c9da3bcf620949'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:32.097625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2395b5604780462a87c9da3bcf620949'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:32.113870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2395b5604780462a87c9da3bcf620949'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:32.114836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2395b5604780462a87c9da3bcf620949'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:32.124689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2395b5604780462a87c9da3bcf620949'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:32.147410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1139/2318] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:31 2022] DELETE /identity/v3/users/2395b5604780462a87c9da3bcf620949 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:32.152870 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75e486-b658-4ea1-9584-2eaea9fed8cc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:32.153358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75e486-b658-4ea1-9584-2eaea9fed8cc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:32.153446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75e486-b658-4ea1-9584-2eaea9fed8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:32.177219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ae75e486-b658-4ea1-9584-2eaea9fed8cc None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:32.178387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ae75e486-b658-4ea1-9584-2eaea9fed8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:32.289074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1180/2319] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:32.314977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:32.318271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:32.339714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:32.417373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02dd48-32e9-4804-b1e5-43752c5cbf4e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:32.423988 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b59e2-f0f5-49b0-9124-8c44891c71b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:32.425292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b59e2-f0f5-49b0-9124-8c44891c71b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:32.425828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b59e2-f0f5-49b0-9124-8c44891c71b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:32.426315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b59e2-f0f5-49b0-9124-8c44891c71b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:32.441553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b59e2-f0f5-49b0-9124-8c44891c71b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:32.443543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b59e2-f0f5-49b0-9124-8c44891c71b8 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:32.468408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1140/2320] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:32.911998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75e486-b658-4ea1-9584-2eaea9fed8cc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:32.913462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ae75e486-b658-4ea1-9584-2eaea9fed8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:32.927784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75e486-b658-4ea1-9584-2eaea9fed8cc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:32.938611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:32.939653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:32.939797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:32.940328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] PATH_INFO: `/v3/projects/5a89571bdcb748a4aae538c5827f6361` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:32.941558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a89571bdcb748a4aae538c5827f6361)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:32.943583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:32.996043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a89571bdcb748a4aae538c5827f6361', 'request_id': 'req-0f1cc20f-da0f-40b1-87f8-871a760c6bea'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:33.002407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a89571bdcb748a4aae538c5827f6361', 'request_id': 'req-0f1cc20f-da0f-40b1-87f8-871a760c6bea'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:33.011769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a89571bdcb748a4aae538c5827f6361', 'request_id': 'req-0f1cc20f-da0f-40b1-87f8-871a760c6bea'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:33.024711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] The token cache is being invalidate because project 5a89571bdcb748a4aae538c5827f6361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:33.024995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:33.025675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0f1cc20f-da0f-40b1-87f8-871a760c6bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:33.028296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1181/2321] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:32 2022] DELETE /identity/v3/projects/5a89571bdcb748a4aae538c5827f6361 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:33.033793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89cfb1-5ca3-4801-ad96-4d191d4162f1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.034292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89cfb1-5ca3-4801-ad96-4d191d4162f1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.034427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89cfb1-5ca3-4801-ad96-4d191d4162f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.052995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5a89cfb1-5ca3-4801-ad96-4d191d4162f1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:33.054207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5a89cfb1-5ca3-4801-ad96-4d191d4162f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:33.113873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1141/2322] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:33.121472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f656e1-845a-43a6-8e5f-cf1a2dc7885d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.121748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f656e1-845a-43a6-8e5f-cf1a2dc7885d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.122021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f656e1-845a-43a6-8e5f-cf1a2dc7885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.141107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-31f656e1-845a-43a6-8e5f-cf1a2dc7885d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:33.142317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-31f656e1-845a-43a6-8e5f-cf1a2dc7885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:33.151205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1182/2323] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:33.155889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89cfb1-5ca3-4801-ad96-4d191d4162f1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:33.166481 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89cfb1-5ca3-4801-ad96-4d191d4162f1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:33.171257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:33.171925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.172243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.172521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.173255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:19:33.173561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:33.175182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:33.187341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1142/2324] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:19:33.191741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f656e1-845a-43a6-8e5f-cf1a2dc7885d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:33.205897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f656e1-845a-43a6-8e5f-cf1a2dc7885d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:33.210672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f261b-925c-4d45-8831-ca961cdf13eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:33.211874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f261b-925c-4d45-8831-ca961cdf13eb admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.211874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f261b-925c-4d45-8831-ca961cdf13eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.211874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f261b-925c-4d45-8831-ca961cdf13eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.213149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f261b-925c-4d45-8831-ca961cdf13eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:33.215099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f261b-925c-4d45-8831-ca961cdf13eb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:33.223812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:33.243876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1183/2325] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:33 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:33.247968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:33.258962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450a4f0-d66f-41b4-8d04-52eb830780a2 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:33.316506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4076963-6892-4e35-a059-863811e3d5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:33.317178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076963-6892-4e35-a059-863811e3d5cf admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.317456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076963-6892-4e35-a059-863811e3d5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.317737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4076963-6892-4e35-a059-863811e3d5cf admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.318421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4076963-6892-4e35-a059-863811e3d5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:33.320338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4076963-6892-4e35-a059-863811e3d5cf admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:33.340865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1143/2326] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:33 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:33.345166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f261b-925c-4d45-8831-ca961cdf13eb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:33.355726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f261b-925c-4d45-8831-ca961cdf13eb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:33.360401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febef27-dcbb-43f3-9f37-3e693b011769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:33.361418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febef27-dcbb-43f3-9f37-3e693b011769 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.361701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febef27-dcbb-43f3-9f37-3e693b011769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.361974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febef27-dcbb-43f3-9f37-3e693b011769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.362725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febef27-dcbb-43f3-9f37-3e693b011769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:33.364401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febef27-dcbb-43f3-9f37-3e693b011769 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:33.374459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1184/2327] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:19:33.378441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4076963-6892-4e35-a059-863811e3d5cf admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:33.389465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4076963-6892-4e35-a059-863811e3d5cf admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:33.395225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09554948-45ea-4e16-8ff5-f496351b3536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:33.396004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554948-45ea-4e16-8ff5-f496351b3536 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.396429 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554948-45ea-4e16-8ff5-f496351b3536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.396801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554948-45ea-4e16-8ff5-f496351b3536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.397625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554948-45ea-4e16-8ff5-f496351b3536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:33.400917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554948-45ea-4e16-8ff5-f496351b3536 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:33.414919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1144/2328] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:33.419395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febef27-dcbb-43f3-9f37-3e693b011769 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:33.430134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febef27-dcbb-43f3-9f37-3e693b011769 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:33.434816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:33.435723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.436009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.436331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] PATH_INFO: `/v3/projects/a7c7cdcd20604c1294fb9088ac844928/users/d508f22381654505bcb25f225a68ff62/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.455380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c7cdcd20604c1294fb9088ac844928, user_id=d508f22381654505bcb25f225a68ff62, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:33.458014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:33.473086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1185/2329] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:33 2022] PUT /identity/v3/projects/a7c7cdcd20604c1294fb9088ac844928/users/d508f22381654505bcb25f225a68ff62/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:33.486410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9f02c-d912-40f1-b247-09df6954d8b7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.486410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9f02c-d912-40f1-b247-09df6954d8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.486410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9f02c-d912-40f1-b247-09df6954d8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.535048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-54b9f02c-d912-40f1-b247-09df6954d8b7 None None] MFA Rules not processed for user `d508f22381654505bcb25f225a68ff62`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:33.539375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-54b9f02c-d912-40f1-b247-09df6954d8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:33.544021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:33.613031 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1145/2330] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:33.624248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:33.625918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:33.694283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbb391-d1a3-49e5-a8bc-52315b4decef admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:33.699525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb380c9-c8bb-46ea-80f9-f9b8aab3a814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:33.700522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb380c9-c8bb-46ea-80f9-f9b8aab3a814 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.700875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb380c9-c8bb-46ea-80f9-f9b8aab3a814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.701335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb380c9-c8bb-46ea-80f9-f9b8aab3a814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.712427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb380c9-c8bb-46ea-80f9-f9b8aab3a814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:33.714482 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb380c9-c8bb-46ea-80f9-f9b8aab3a814 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:33.727282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1186/2331] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:33.829412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9f02c-d912-40f1-b247-09df6954d8b7 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:33.830821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-54b9f02c-d912-40f1-b247-09df6954d8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:33.919401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9f02c-d912-40f1-b247-09df6954d8b7 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:33.926150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:33.927118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:33.927434 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:33.927768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] PATH_INFO: `/v3/users/03a0cbf981614773a7bdd589b6d52a16` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:33.929249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a0cbf981614773a7bdd589b6d52a16)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:33.931592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:34.028916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a0cbf981614773a7bdd589b6d52a16'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.030225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a0cbf981614773a7bdd589b6d52a16'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.049969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a0cbf981614773a7bdd589b6d52a16'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.051104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a0cbf981614773a7bdd589b6d52a16'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.063937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a0cbf981614773a7bdd589b6d52a16'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.091895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1146/2332] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:33 2022] DELETE /identity/v3/users/03a0cbf981614773a7bdd589b6d52a16 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:34.098134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e970-948e-4833-b49c-3cad450dec76 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:34.098421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e970-948e-4833-b49c-3cad450dec76 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:34.098681 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e970-948e-4833-b49c-3cad450dec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:34.134536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-91e8e970-948e-4833-b49c-3cad450dec76 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:34.136422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-91e8e970-948e-4833-b49c-3cad450dec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:34.219726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1187/2333] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:34.232866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:34.234375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:34.262593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:34.295725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92696e8b-9581-494c-90c1-03f4725cf15f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:34.300262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:34.300917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:34.301197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:34.301470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:34.311323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:34.312782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:34.322978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1147/2334] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:34.611110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8e970-948e-4833-b49c-3cad450dec76 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:34.612932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-91e8e970-948e-4833-b49c-3cad450dec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:34.630306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8e970-948e-4833-b49c-3cad450dec76 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:34.637883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:34.638784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:34.639071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:34.639560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] PATH_INFO: `/v3/projects/eee43603313c41129dc2f15e85fe6cff` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:34.641028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee43603313c41129dc2f15e85fe6cff)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:34.643470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:34.708770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee43603313c41129dc2f15e85fe6cff', 'request_id': 'req-048514a3-3a99-4110-b9d0-53c97dfd3948'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.710984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:34.716866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee43603313c41129dc2f15e85fe6cff', 'request_id': 'req-048514a3-3a99-4110-b9d0-53c97dfd3948'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.726335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee43603313c41129dc2f15e85fe6cff', 'request_id': 'req-048514a3-3a99-4110-b9d0-53c97dfd3948'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.743008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] The token cache is being invalidate because project eee43603313c41129dc2f15e85fe6cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:34.743508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.744818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-048514a3-3a99-4110-b9d0-53c97dfd3948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:34.747492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1188/2335] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:34 2022] DELETE /identity/v3/projects/eee43603313c41129dc2f15e85fe6cff => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:19:37.100997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:37.102854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:37.116179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e067d0-6fc2-4852-8b46-421698215e43 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:37.171370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:37.172303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:37.172585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:37.172885 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] PATH_INFO: `/v3/users/047f58e96e6340d7bd00558233e551c9` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:37.174072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=047f58e96e6340d7bd00558233e551c9)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:37.176006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:37.227057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047f58e96e6340d7bd00558233e551c9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.227718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047f58e96e6340d7bd00558233e551c9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.239512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047f58e96e6340d7bd00558233e551c9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.240184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047f58e96e6340d7bd00558233e551c9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.248490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047f58e96e6340d7bd00558233e551c9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.261221 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1148/2336] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:37 2022] DELETE /identity/v3/users/047f58e96e6340d7bd00558233e551c9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:37.265739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04495a11-7e73-4ada-9fde-2c9ed8419f4e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:37.266235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04495a11-7e73-4ada-9fde-2c9ed8419f4e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:37.266454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04495a11-7e73-4ada-9fde-2c9ed8419f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:37.284893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-04495a11-7e73-4ada-9fde-2c9ed8419f4e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:37.286254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-04495a11-7e73-4ada-9fde-2c9ed8419f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:37.353763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1189/2337] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:37.363966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:37.365394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:37.417621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:37.423532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c308d-2b4f-4033-bfd7-84043c645c47 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:37.428222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:37.428868 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:37.429148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:37.429422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:37.439132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:37.440610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:37.450589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1149/2338] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:37.786120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04495a11-7e73-4ada-9fde-2c9ed8419f4e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:37.787641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-04495a11-7e73-4ada-9fde-2c9ed8419f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:37.812734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04495a11-7e73-4ada-9fde-2c9ed8419f4e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:37.817819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:37.818798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:37.819094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:37.819368 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] PATH_INFO: `/v3/projects/efd6ce35f1f046da9df361003854cb1f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:37.820677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd6ce35f1f046da9df361003854cb1f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:37.823260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:37.883207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd6ce35f1f046da9df361003854cb1f', 'request_id': 'req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.889893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd6ce35f1f046da9df361003854cb1f', 'request_id': 'req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.910110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd6ce35f1f046da9df361003854cb1f', 'request_id': 'req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.926012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] The token cache is being invalidate because project efd6ce35f1f046da9df361003854cb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:37.926319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.927064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ad54f80-f5e8-41c7-bc32-55a5305e4ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:37.946304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1190/2339] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:37 2022] DELETE /identity/v3/projects/efd6ce35f1f046da9df361003854cb1f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:42.449392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:42.450835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:42.464011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9458cd-ed1f-489f-bdce-861000bd1db8 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:42.526266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:42.527181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:42.527466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:42.527746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] PATH_INFO: `/v3/users/5dba6e6488d74a779be642f1a3f0cc0d` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:42.529277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dba6e6488d74a779be642f1a3f0cc0d)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:42.531346 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:42.590104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dba6e6488d74a779be642f1a3f0cc0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:42.590796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dba6e6488d74a779be642f1a3f0cc0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:42.603432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dba6e6488d74a779be642f1a3f0cc0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:42.604131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dba6e6488d74a779be642f1a3f0cc0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:42.611500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dba6e6488d74a779be642f1a3f0cc0d'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:42.624587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1150/2340] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:42 2022] DELETE /identity/v3/users/5dba6e6488d74a779be642f1a3f0cc0d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:42.629235 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608526-6e1c-4605-bf34-9092883482eb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:42.629743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608526-6e1c-4605-bf34-9092883482eb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:42.629848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5608526-6e1c-4605-bf34-9092883482eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:42.649819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b5608526-6e1c-4605-bf34-9092883482eb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:42.651148 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b5608526-6e1c-4605-bf34-9092883482eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:42.714018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1191/2341] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:42.723970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:42.725417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:42.793640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb912fd-f691-4a09-9c62-e434f2a95392 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:42.798672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:42.799458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:42.799829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:42.800255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:42.811665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:42.813417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:42.826752 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1151/2342] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:43.145650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5608526-6e1c-4605-bf34-9092883482eb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:43.147185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b5608526-6e1c-4605-bf34-9092883482eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:43.159848 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:43.168524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5608526-6e1c-4605-bf34-9092883482eb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:43.181670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:43.182573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:43.182857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:43.183136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] PATH_INFO: `/v3/projects/0f855195b0244a3881f8571c203c8e2c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:43.184415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f855195b0244a3881f8571c203c8e2c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:43.186353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:43.242862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f855195b0244a3881f8571c203c8e2c', 'request_id': 'req-7891a2e8-ab24-4297-add2-b8ead76967bb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:43.260045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f855195b0244a3881f8571c203c8e2c', 'request_id': 'req-7891a2e8-ab24-4297-add2-b8ead76967bb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:43.272612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f855195b0244a3881f8571c203c8e2c', 'request_id': 'req-7891a2e8-ab24-4297-add2-b8ead76967bb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:43.291280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] The token cache is being invalidate because project 0f855195b0244a3881f8571c203c8e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:43.291743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:43.292797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7891a2e8-ab24-4297-add2-b8ead76967bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:43.296067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1192/2343] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:43 2022] DELETE /identity/v3/projects/0f855195b0244a3881f8571c203c8e2c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:45.518374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:45.520581 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:45.538884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce797fea-71e4-4ac5-9e66-a8b5fded4a4b service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:45.548185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:45.604652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:45.605511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:45.605917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:45.606196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] PATH_INFO: `/v3/users/d508f22381654505bcb25f225a68ff62` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:45.607431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d508f22381654505bcb25f225a68ff62)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:45.609406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:45.658928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd508f22381654505bcb25f225a68ff62'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:45.659603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd508f22381654505bcb25f225a68ff62'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:45.672811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd508f22381654505bcb25f225a68ff62'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:45.673523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd508f22381654505bcb25f225a68ff62'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:45.681883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd508f22381654505bcb25f225a68ff62'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:45.695261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1152/2344] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:19:45 2022] DELETE /identity/v3/users/d508f22381654505bcb25f225a68ff62 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:45.699760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d787-ad16-4a2c-b906-c8d99a864000 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:45.700342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d787-ad16-4a2c-b906-c8d99a864000 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:45.700438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276d787-ad16-4a2c-b906-c8d99a864000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:45.719959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c276d787-ad16-4a2c-b906-c8d99a864000 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:45.721263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c276d787-ad16-4a2c-b906-c8d99a864000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:45.788186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1193/2345] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:45.798629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:45.800226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:45.863310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ed962-5fb5-44a8-8313-9f789717e267 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:45.866991 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458b733-b0f2-4117-b806-567566920186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:45.867657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b733-b0f2-4117-b806-567566920186 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:45.868513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b733-b0f2-4117-b806-567566920186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:45.868846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458b733-b0f2-4117-b806-567566920186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:45.879455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458b733-b0f2-4117-b806-567566920186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:45.881240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458b733-b0f2-4117-b806-567566920186 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:45.892822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1153/2346] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:46.158007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d787-ad16-4a2c-b906-c8d99a864000 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:46.159434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c276d787-ad16-4a2c-b906-c8d99a864000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:46.176433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276d787-ad16-4a2c-b906-c8d99a864000 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:46.181508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:46.182392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.182692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.182932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] PATH_INFO: `/v3/projects/a7c7cdcd20604c1294fb9088ac844928` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.184193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c7cdcd20604c1294fb9088ac844928)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:46.186156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:46.234286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c7cdcd20604c1294fb9088ac844928', 'request_id': 'req-cb369dd5-e198-4dcb-83ce-d48462d847e4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:46.240451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c7cdcd20604c1294fb9088ac844928', 'request_id': 'req-cb369dd5-e198-4dcb-83ce-d48462d847e4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:46.248010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c7cdcd20604c1294fb9088ac844928', 'request_id': 'req-cb369dd5-e198-4dcb-83ce-d48462d847e4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:46.259050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] The token cache is being invalidate because project a7c7cdcd20604c1294fb9088ac844928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:19:46.259342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:46.259968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb369dd5-e198-4dcb-83ce-d48462d847e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:19:46.261795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1194/2347] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:19:46 2022] DELETE /identity/v3/projects/a7c7cdcd20604c1294fb9088ac844928 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:46.266916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35880e-8640-4dd5-9c11-3dbaba855991 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.267213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35880e-8640-4dd5-9c11-3dbaba855991 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.267498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35880e-8640-4dd5-9c11-3dbaba855991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.288586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2a35880e-8640-4dd5-9c11-3dbaba855991 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:46.290113 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2a35880e-8640-4dd5-9c11-3dbaba855991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:46.325400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:46.361014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1154/2348] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:46.430017 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548269e-d55c-4c79-8fa0-572674ea8d50 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.431220 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548269e-d55c-4c79-8fa0-572674ea8d50 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.431742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548269e-d55c-4c79-8fa0-572674ea8d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.461898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e548269e-d55c-4c79-8fa0-572674ea8d50 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:46.463180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e548269e-d55c-4c79-8fa0-572674ea8d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:46.473915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1195/2349] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:46.480435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35880e-8640-4dd5-9c11-3dbaba855991 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:46.491245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35880e-8640-4dd5-9c11-3dbaba855991 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:46.497029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:46.497817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.498125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.498406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.499225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:19:46.499557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:46.501359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:46.515233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1155/2350] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:19:46.520331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548269e-d55c-4c79-8fa0-572674ea8d50 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:46.527138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:46.531426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548269e-d55c-4c79-8fa0-572674ea8d50 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:46.540997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630541d3-92b2-47d6-a900-2e9cfe91d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:46.541831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630541d3-92b2-47d6-a900-2e9cfe91d90d admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.542176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630541d3-92b2-47d6-a900-2e9cfe91d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.542511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630541d3-92b2-47d6-a900-2e9cfe91d90d admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.543288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630541d3-92b2-47d6-a900-2e9cfe91d90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:46.546367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630541d3-92b2-47d6-a900-2e9cfe91d90d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:46.582439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1196/2351] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:46 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:46.587591 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:46.597707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944b2d7-4335-4715-b91d-659dd6a7f2a9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:46.666006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43b4c3-52a7-487f-8f10-114474b814ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:46.666780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43b4c3-52a7-487f-8f10-114474b814ca admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.667131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43b4c3-52a7-487f-8f10-114474b814ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.667441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43b4c3-52a7-487f-8f10-114474b814ca admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.668232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43b4c3-52a7-487f-8f10-114474b814ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:46.670352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43b4c3-52a7-487f-8f10-114474b814ca admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:46.694982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1156/2352] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:46 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:46.699064 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630541d3-92b2-47d6-a900-2e9cfe91d90d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:46.709972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630541d3-92b2-47d6-a900-2e9cfe91d90d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:46.716021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896f313-f36c-4b15-a15a-4559e7767efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:46.716743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896f313-f36c-4b15-a15a-4559e7767efa admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.717036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896f313-f36c-4b15-a15a-4559e7767efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.717312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896f313-f36c-4b15-a15a-4559e7767efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.718076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896f313-f36c-4b15-a15a-4559e7767efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:46.719727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896f313-f36c-4b15-a15a-4559e7767efa admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:46.732976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1197/2353] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:46.737372 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43b4c3-52a7-487f-8f10-114474b814ca admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:46.754739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43b4c3-52a7-487f-8f10-114474b814ca admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:46.763771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48e2c3-af70-430d-beb4-bebb006682e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:46.764484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48e2c3-af70-430d-beb4-bebb006682e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.764765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48e2c3-af70-430d-beb4-bebb006682e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.765051 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48e2c3-af70-430d-beb4-bebb006682e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.765780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48e2c3-af70-430d-beb4-bebb006682e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:46.767398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48e2c3-af70-430d-beb4-bebb006682e2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:46.779714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1157/2354] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:46.783987 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896f313-f36c-4b15-a15a-4559e7767efa admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:46.794133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896f313-f36c-4b15-a15a-4559e7767efa admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:46.798756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:46.799685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.799935 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.800254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] PATH_INFO: `/v3/projects/be9aa426f5f64191bfd0b22e0b082edc/users/8ed42168b1a043e39cec540c299217e5/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.817913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9aa426f5f64191bfd0b22e0b082edc, user_id=8ed42168b1a043e39cec540c299217e5, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:46.821559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:46.838151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1198/2355] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:46 2022] PUT /identity/v3/projects/be9aa426f5f64191bfd0b22e0b082edc/users/8ed42168b1a043e39cec540c299217e5/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:46.844732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f175-cb76-400d-af38-8946335f6da8 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:46.845260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f175-cb76-400d-af38-8946335f6da8 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:46.845703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58f175-cb76-400d-af38-8946335f6da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:46.867218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-df58f175-cb76-400d-af38-8946335f6da8 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:46.868571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-df58f175-cb76-400d-af38-8946335f6da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:46.945384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1158/2356] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:46.956839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:46.958700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:47.022964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8544ba-a1e0-47a4-a757-106c7201c95a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:47.027452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf274a-accc-4937-a7f9-2c362bd4ade8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:47.028236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf274a-accc-4937-a7f9-2c362bd4ade8 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:47.028517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf274a-accc-4937-a7f9-2c362bd4ade8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:47.028802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf274a-accc-4937-a7f9-2c362bd4ade8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:47.039468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf274a-accc-4937-a7f9-2c362bd4ade8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:47.041179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf274a-accc-4937-a7f9-2c362bd4ade8 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:47.052283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1199/2357] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:51.469347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9e86-b9ed-4b75-bbb8-4ed93bd06116 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:51.469896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9e86-b9ed-4b75-bbb8-4ed93bd06116 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:51.469896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e9e86-b9ed-4b75-bbb8-4ed93bd06116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:51.524852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f71e9e86-b9ed-4b75-bbb8-4ed93bd06116 None None] MFA Rules not processed for user `8ed42168b1a043e39cec540c299217e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:51.526156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f71e9e86-b9ed-4b75-bbb8-4ed93bd06116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:51.578523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:51.626930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1159/2358] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:51.631771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf274a-accc-4937-a7f9-2c362bd4ade8 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:51.644346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf274a-accc-4937-a7f9-2c362bd4ade8 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:51.649365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2ffb-b07e-4ba3-a8bc-1136f1a9a854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:51.650033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2ffb-b07e-4ba3-a8bc-1136f1a9a854 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:51.650316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2ffb-b07e-4ba3-a8bc-1136f1a9a854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:51.650591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2ffb-b07e-4ba3-a8bc-1136f1a9a854 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:51.651289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f2ffb-b07e-4ba3-a8bc-1136f1a9a854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:51.653806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f2ffb-b07e-4ba3-a8bc-1136f1a9a854 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:51.681339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1200/2359] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:19:51 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:19:51.685605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e9e86-b9ed-4b75-bbb8-4ed93bd06116 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:51.698319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e9e86-b9ed-4b75-bbb8-4ed93bd06116 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:51.760606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac56f28-e6e5-4c40-bf18-674a52d1ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:51.761303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac56f28-e6e5-4c40-bf18-674a52d1ea3d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:51.761584 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac56f28-e6e5-4c40-bf18-674a52d1ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:51.761861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac56f28-e6e5-4c40-bf18-674a52d1ea3d admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:51.762590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac56f28-e6e5-4c40-bf18-674a52d1ea3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:51.764585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac56f28-e6e5-4c40-bf18-674a52d1ea3d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:51.790592 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1160/2360] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:19:51 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:19:51.794794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2ffb-b07e-4ba3-a8bc-1136f1a9a854 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:51.806378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2ffb-b07e-4ba3-a8bc-1136f1a9a854 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:51.812465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9737652-8613-4984-833d-203563a1c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:51.813150 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737652-8613-4984-833d-203563a1c736 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:51.813436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737652-8613-4984-833d-203563a1c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:51.814844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9737652-8613-4984-833d-203563a1c736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:51.815695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9737652-8613-4984-833d-203563a1c736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:51.817319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9737652-8613-4984-833d-203563a1c736 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:51.830552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1201/2361] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:51.834589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac56f28-e6e5-4c40-bf18-674a52d1ea3d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:51.846446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac56f28-e6e5-4c40-bf18-674a52d1ea3d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:51.851176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9300aa2-9d07-49cb-bb6f-f8fabcf411f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:51.852159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300aa2-9d07-49cb-bb6f-f8fabcf411f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:51.852435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300aa2-9d07-49cb-bb6f-f8fabcf411f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:51.852708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300aa2-9d07-49cb-bb6f-f8fabcf411f0 admin admin] PATH_INFO: `/v3/projects/557e1207ab1143049926f59f91891879/users/ceea44819f0543d6a2551e044622aa71/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:51.869531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9300aa2-9d07-49cb-bb6f-f8fabcf411f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557e1207ab1143049926f59f91891879, user_id=ceea44819f0543d6a2551e044622aa71, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:51.872859 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9300aa2-9d07-49cb-bb6f-f8fabcf411f0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:51.890121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1161/2362] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:51 2022] PUT /identity/v3/projects/557e1207ab1143049926f59f91891879/users/ceea44819f0543d6a2551e044622aa71/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:51.894206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9737652-8613-4984-833d-203563a1c736 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:51.907902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9737652-8613-4984-833d-203563a1c736 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:52.032781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c851d-f00f-4dd2-960b-61f6143cc34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:52.033502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c851d-f00f-4dd2-960b-61f6143cc34a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:52.033765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c851d-f00f-4dd2-960b-61f6143cc34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:52.035726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c851d-f00f-4dd2-960b-61f6143cc34a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:52.036616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c851d-f00f-4dd2-960b-61f6143cc34a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:52.038336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c851d-f00f-4dd2-960b-61f6143cc34a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:52.056928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1202/2363] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:19:52.058157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9300aa2-9d07-49cb-bb6f-f8fabcf411f0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:52.070350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9300aa2-9d07-49cb-bb6f-f8fabcf411f0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:52.077208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:52.078642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:52.078769 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:52.079006 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] PATH_INFO: `/v3/projects/557e1207ab1143049926f59f91891879/users/ceea44819f0543d6a2551e044622aa71/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:52.081203 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=557e1207ab1143049926f59f91891879, user_id=ceea44819f0543d6a2551e044622aa71, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:52.083907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:52.101004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1162/2364] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:19:52 2022] PUT /identity/v3/projects/557e1207ab1143049926f59f91891879/users/ceea44819f0543d6a2551e044622aa71/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:19:57.345293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdbdd-a149-4956-9b35-cc9a82e1f62e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:57.345842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdbdd-a149-4956-9b35-cc9a82e1f62e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:57.346246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bdbdd-a149-4956-9b35-cc9a82e1f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:57.376726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:57.381052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9a8bdbdd-a149-4956-9b35-cc9a82e1f62e None None] MFA Rules not processed for user `ceea44819f0543d6a2551e044622aa71`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:57.383849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9a8bdbdd-a149-4956-9b35-cc9a82e1f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:57.478798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1203/2365] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:19:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:57.494530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:57.496531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:57.578493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e48fd3-b369-45bb-a652-de65d45a7acb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:57.583408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c97bd14230147a5bd004c71f5387098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:57.584073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:57.584403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:57.584680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:57.626567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:19:57.657106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:57.658930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:57.675294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1163/2366] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:19:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:19:57.826432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148d6e-043a-4e0d-b97e-ac1f6ee8bc2f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:57.827159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148d6e-043a-4e0d-b97e-ac1f6ee8bc2f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:57.827433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef148d6e-043a-4e0d-b97e-ac1f6ee8bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:57.854495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ef148d6e-043a-4e0d-b97e-ac1f6ee8bc2f None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:19:57.855736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ef148d6e-043a-4e0d-b97e-ac1f6ee8bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:57.933276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1204/2367] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:19:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:19:57.951952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:19:57.955139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:19:58.084581 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595ab76-1fe7-42ee-a8a2-a2c17d151390 service glance] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:19:58.094387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ef061-7f34-4119-a741-8a612f1ace9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:19:58.095527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef061-7f34-4119-a741-8a612f1ace9b service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:19:58.095814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef061-7f34-4119-a741-8a612f1ace9b service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:19:58.096093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ef061-7f34-4119-a741-8a612f1ace9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:19:58.109837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ef061-7f34-4119-a741-8a612f1ace9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:19:58.111555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ef061-7f34-4119-a741-8a612f1ace9b service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:19:58.124999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1164/2368] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:19:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:20:07.618212 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17b0ad-bf63-47d0-a819-cc1225d59ff2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:20:07.620202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17b0ad-bf63-47d0-a819-cc1225d59ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:20:07.620712 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17b0ad-bf63-47d0-a819-cc1225d59ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:20:07.640950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fa17b0ad-bf63-47d0-a819-cc1225d59ff2 None None] MFA Rules not processed for user `8ed42168b1a043e39cec540c299217e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:20:07.642179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fa17b0ad-bf63-47d0-a819-cc1225d59ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:20:07.649054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1205/2369] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:20:08.118271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=43 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:09.585574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a932fe-87e7-45d7-bfa1-09b2cd5bab4f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:20:09.586190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a932fe-87e7-45d7-bfa1-09b2cd5bab4f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:20:09.586190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a932fe-87e7-45d7-bfa1-09b2cd5bab4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:20:09.605946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b2a932fe-87e7-45d7-bfa1-09b2cd5bab4f None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:20:09.607107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b2a932fe-87e7-45d7-bfa1-09b2cd5bab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:20:09.614415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1165/2370] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:20:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:20:09.628000 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17b0ad-bf63-47d0-a819-cc1225d59ff2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:20:09.641340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17b0ad-bf63-47d0-a819-cc1225d59ff2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:20:09.646548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:20:09.647218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:20:09.647502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:20:09.647781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:20:09.657721 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:20:09.659442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:20:09.669623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1206/2371] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:20:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:20:19.599863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:19.666060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=62 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:35.402273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a01d-1101-4644-b87a-d378f714d1c3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:20:35.402838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a01d-1101-4644-b87a-d378f714d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:20:35.402942 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7a01d-1101-4644-b87a-d378f714d1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:20:35.423544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-a9d7a01d-1101-4644-b87a-d378f714d1c3 None None] MFA Rules not processed for user `f38b26b3a2b6480ead16fb239b327d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:20:35.425094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a9d7a01d-1101-4644-b87a-d378f714d1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:20:35.484225 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1166/2372] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:20:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:20:37.083751 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:20:37.085359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:20:37.171797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7f8a7-865e-46e2-8bb6-b112a9314c4d service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:20:37.182110 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331a163-7c1c-44c4-b430-b4da30984293 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:20:37.182853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331a163-7c1c-44c4-b430-b4da30984293 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:20:37.183187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331a163-7c1c-44c4-b430-b4da30984293 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:20:37.183454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331a163-7c1c-44c4-b430-b4da30984293 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:20:37.185622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c331a163-7c1c-44c4-b430-b4da30984293 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:20:37.199920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331a163-7c1c-44c4-b430-b4da30984293 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:20:37.201711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331a163-7c1c-44c4-b430-b4da30984293 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:20:37.215789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1207/2373] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:20:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:20:45.476849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=25 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:47.208855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=32 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:20:49.134349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7a01d-1101-4644-b87a-d378f714d1c3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:20:49.198918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7a01d-1101-4644-b87a-d378f714d1c3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:20:49.203116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088388-2b09-4c95-a230-168144ca75ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:20:49.204056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088388-2b09-4c95-a230-168144ca75ef service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:20:49.204360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088388-2b09-4c95-a230-168144ca75ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:20:49.204634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46088388-2b09-4c95-a230-168144ca75ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:20:49.215454 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46088388-2b09-4c95-a230-168144ca75ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:20:49.216952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46088388-2b09-4c95-a230-168144ca75ef service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:20:49.227939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1167/2374] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:20:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:20:58.247700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1b2fb-b8de-4be1-9c75-93f253a6c229 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:20:58.248347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1b2fb-b8de-4be1-9c75-93f253a6c229 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:20:58.248347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1b2fb-b8de-4be1-9c75-93f253a6c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:20:58.269078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7de1b2fb-b8de-4be1-9c75-93f253a6c229 None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:20:58.270344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7de1b2fb-b8de-4be1-9c75-93f253a6c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:20:58.283094 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1208/2375] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:20:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:20:58.311411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088388-2b09-4c95-a230-168144ca75ef service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:20:58.325484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46088388-2b09-4c95-a230-168144ca75ef service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:20:58.334918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ebc12-4bad-4902-9a2c-e68b76412061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:20:58.335707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ebc12-4bad-4902-9a2c-e68b76412061 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:20:58.336062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ebc12-4bad-4902-9a2c-e68b76412061 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:20:58.336457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ebc12-4bad-4902-9a2c-e68b76412061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:20:58.348595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ebc12-4bad-4902-9a2c-e68b76412061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:20:58.351023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ebc12-4bad-4902-9a2c-e68b76412061 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:20:58.361168 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1168/2376] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:20:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 11:21:03.002103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b536a1-6592-4e12-a888-0e4a05725e04 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:03.003019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b536a1-6592-4e12-a888-0e4a05725e04 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:03.003888 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b536a1-6592-4e12-a888-0e4a05725e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:03.030036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-16b536a1-6592-4e12-a888-0e4a05725e04 None None] MFA Rules not processed for user `f55c9792e2fe46cc9fc86d4c0f38f4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:21:03.031392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-16b536a1-6592-4e12-a888-0e4a05725e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:21:03.125227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1209/2377] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:21:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:21:08.357325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=32 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:13.113922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=28 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:18.064882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465f2b-2e45-43f9-b07e-cffd9e41ff63 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.065457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465f2b-2e45-43f9-b07e-cffd9e41ff63 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.065457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92465f2b-2e45-43f9-b07e-cffd9e41ff63 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.066769 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1169/2378] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:21:18.073070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256678f-b3e2-49a0-b911-02ff7469efbd None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.073604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256678f-b3e2-49a0-b911-02ff7469efbd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.073754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256678f-b3e2-49a0-b911-02ff7469efbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.103766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5256678f-b3e2-49a0-b911-02ff7469efbd None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:21:18.106057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5256678f-b3e2-49a0-b911-02ff7469efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:21:18.186316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1210/2379] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:21:18.198079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92465f2b-2e45-43f9-b07e-cffd9e41ff63 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:21:18.211773 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92465f2b-2e45-43f9-b07e-cffd9e41ff63 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:21:18.215516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3c6af-6c7f-441d-95b5-4ddc5268c274 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c97bd14230147a5bd004c71f5387098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:21:18.216189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c6af-6c7f-441d-95b5-4ddc5268c274 service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.216600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c6af-6c7f-441d-95b5-4ddc5268c274 service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.216882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3c6af-6c7f-441d-95b5-4ddc5268c274 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.228151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3c6af-6c7f-441d-95b5-4ddc5268c274 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:21:18.229583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3c6af-6c7f-441d-95b5-4ddc5268c274 service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:21:18.242875 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1170/2380] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:21:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:21:18.317639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462fe2b-c538-47d2-88ca-c17f2842fe51 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.317919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462fe2b-c538-47d2-88ca-c17f2842fe51 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.318292 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462fe2b-c538-47d2-88ca-c17f2842fe51 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.320233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1211/2381] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:21:18.328395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bde2a-f913-474e-8b0e-5c2280505b89 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.328956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bde2a-f913-474e-8b0e-5c2280505b89 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.329246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bde2a-f913-474e-8b0e-5c2280505b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.349811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-136bde2a-f913-474e-8b0e-5c2280505b89 None None] MFA Rules not processed for user `a367d904a4a44e91862da4aea28a123b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:21:18.351053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-136bde2a-f913-474e-8b0e-5c2280505b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:21:18.357740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1171/2382] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:21:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:21:18.369610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462fe2b-c538-47d2-88ca-c17f2842fe51 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:21:18.383777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462fe2b-c538-47d2-88ca-c17f2842fe51 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:21:18.387319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f75b64-f6be-4d0a-8578-47c203f422e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:21:18.387960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f75b64-f6be-4d0a-8578-47c203f422e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.388283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f75b64-f6be-4d0a-8578-47c203f422e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.388583 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f75b64-f6be-4d0a-8578-47c203f422e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.395860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f75b64-f6be-4d0a-8578-47c203f422e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:21:18.397322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f75b64-f6be-4d0a-8578-47c203f422e5 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:21:18.405767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1212/2383] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:21:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:21:18.491212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641aaca-ffd5-416b-acb4-22377715f5af None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.491747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641aaca-ffd5-416b-acb4-22377715f5af None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.492268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641aaca-ffd5-416b-acb4-22377715f5af None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.493952 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1172/2384] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:21:18.501491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fc987-2d0b-461b-a97e-b0210e3aa950 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.501788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fc987-2d0b-461b-a97e-b0210e3aa950 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.502068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fc987-2d0b-461b-a97e-b0210e3aa950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.524393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-397fc987-2d0b-461b-a97e-b0210e3aa950 None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:21:18.525608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-397fc987-2d0b-461b-a97e-b0210e3aa950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:21:18.535601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1213/2385] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:21:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:21:18.546887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641aaca-ffd5-416b-acb4-22377715f5af None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:21:18.549535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b641aaca-ffd5-416b-acb4-22377715f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:21:18.567251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641aaca-ffd5-416b-acb4-22377715f5af None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:21:18.571766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556749-07e3-4836-b313-e2103e7dbdc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:21:18.572443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556749-07e3-4836-b313-e2103e7dbdc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:18.572739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556749-07e3-4836-b313-e2103e7dbdc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:18.573017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556749-07e3-4836-b313-e2103e7dbdc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:18.584578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38556749-07e3-4836-b313-e2103e7dbdc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:21:18.586623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38556749-07e3-4836-b313-e2103e7dbdc4 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:21:18.598457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1173/2386] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:21:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:21:21.256221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b342a50-12ab-47b8-94fe-dda6fcf986f9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:21.256657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b342a50-12ab-47b8-94fe-dda6fcf986f9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:21.256784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b342a50-12ab-47b8-94fe-dda6fcf986f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:21.275458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7b342a50-12ab-47b8-94fe-dda6fcf986f9 None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:21:21.276718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7b342a50-12ab-47b8-94fe-dda6fcf986f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:21:21.284031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1214/2387] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:21:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:21:21.296644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556749-07e3-4836-b313-e2103e7dbdc4 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:21:21.309553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556749-07e3-4836-b313-e2103e7dbdc4 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:21:21.316688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0c39-8cb1-4e8b-919f-5aa41036358c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:21:21.317359 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0c39-8cb1-4e8b-919f-5aa41036358c service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:21.317642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0c39-8cb1-4e8b-919f-5aa41036358c service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:21.317923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0c39-8cb1-4e8b-919f-5aa41036358c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:21.327605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb0c39-8cb1-4e8b-919f-5aa41036358c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:21:21.329515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb0c39-8cb1-4e8b-919f-5aa41036358c service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:21:21.338726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1174/2388] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:21:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:21:31.269734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=43 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:31.334593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=21 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:47.756257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe53e4-3ae1-49e5-8bbf-c4529beca050 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:47.756808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe53e4-3ae1-49e5-8bbf-c4529beca050 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:47.756808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe53e4-3ae1-49e5-8bbf-c4529beca050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:47.774205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-20fe53e4-3ae1-49e5-8bbf-c4529beca050 None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:21:47.775919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-20fe53e4-3ae1-49e5-8bbf-c4529beca050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:21:47.783551 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1215/2389] 10.222.0.17 () {58 vars in 967 bytes} [Thu Jul 14 11:21:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:21:47.799013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0c39-8cb1-4e8b-919f-5aa41036358c service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:21:47.810871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0c39-8cb1-4e8b-919f-5aa41036358c service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:21:47.816062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91003-e87c-4e8c-a3e3-b7860ff4c120 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:21:47.816744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91003-e87c-4e8c-a3e3-b7860ff4c120 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:21:47.817025 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91003-e87c-4e8c-a3e3-b7860ff4c120 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:21:47.817296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91003-e87c-4e8c-a3e3-b7860ff4c120 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:21:47.826728 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d91003-e87c-4e8c-a3e3-b7860ff4c120 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:21:47.828358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d91003-e87c-4e8c-a3e3-b7860ff4c120 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:21:47.837553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1175/2390] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:21:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:21:57.769128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:21:57.834082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:40.331141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe53e4-3ae1-49e5-8bbf-c4529beca050 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:22:40.340829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe53e4-3ae1-49e5-8bbf-c4529beca050 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:22:40.344360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:22:40.344991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:22:40.345271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:22:40.345545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:22:40.347797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:22:40.361321 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:22:40.362731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:22:40.373291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1216/2391] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:22:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:22:43.858537 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91003-e87c-4e8c-a3e3-b7860ff4c120 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:22:43.870498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91003-e87c-4e8c-a3e3-b7860ff4c120 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:22:43.875235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839f381-a6dc-4c4e-85a0-e0ae259b8989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:22:43.875882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f381-a6dc-4c4e-85a0-e0ae259b8989 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:22:43.876215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f381-a6dc-4c4e-85a0-e0ae259b8989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:22:43.876500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f381-a6dc-4c4e-85a0-e0ae259b8989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:22:43.878423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f839f381-a6dc-4c4e-85a0-e0ae259b8989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:22:43.892166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839f381-a6dc-4c4e-85a0-e0ae259b8989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:22:43.893607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839f381-a6dc-4c4e-85a0-e0ae259b8989 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:22:43.907179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1176/2392] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:22:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:22:50.368673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:53.899649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:22:57.850242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:22:57.851751 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:22:57.866358 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8e5bd-a4bf-440f-a4dd-2ebe5d026e49 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:22:57.871921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:22:57.872599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:22:57.872881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:22:57.873155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:22:57.874895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:22:57.885920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:22:57.887605 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:22:57.898726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1217/2393] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:22:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:23:07.841167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996bec-d785-4398-beb7-0e885afbe693 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:07.841727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996bec-d785-4398-beb7-0e885afbe693 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:07.841727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996bec-d785-4398-beb7-0e885afbe693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:07.860900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-78996bec-d785-4398-beb7-0e885afbe693 None None] MFA Rules not processed for user `f38b26b3a2b6480ead16fb239b327d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:23:07.862238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-78996bec-d785-4398-beb7-0e885afbe693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:07.869335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1177/2394] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:23:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:23:07.893350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:08.182756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:23:08.192601 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f464a7-c1e3-4877-9aa5-e3a1644db1e7 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:23:08.196416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:23:08.197054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:08.197336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:08.197608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:08.199354 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:08.209754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:23:08.211181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:23:08.221330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1218/2395] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:23:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:23:08.532756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996bec-d785-4398-beb7-0e885afbe693 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:23:08.544837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996bec-d785-4398-beb7-0e885afbe693 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:23:08.550045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:23:08.550696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:08.551166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:08.551438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:08.553297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:08.565864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:23:08.567488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:23:08.578765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1178/2396] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:23:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:23:09.047597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:23:09.049114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:09.066818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06f14-7be5-4dd3-b056-4c90491473d4 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:23:09.072691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6cf7d-43e3-46a5-ba2d-df42df43f48f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:23:09.073419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6cf7d-43e3-46a5-ba2d-df42df43f48f service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:09.073739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6cf7d-43e3-46a5-ba2d-df42df43f48f service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:09.073939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6cf7d-43e3-46a5-ba2d-df42df43f48f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:09.075745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5cd6cf7d-43e3-46a5-ba2d-df42df43f48f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:09.144033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6cf7d-43e3-46a5-ba2d-df42df43f48f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:23:09.145680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6cf7d-43e3-46a5-ba2d-df42df43f48f service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:23:09.155755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1219/2397] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:23:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:23:12.517734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:23:12.528519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05df9d-a04a-4dc9-b116-4e1ed26a7556 service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:23:12.534104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:23:12.534784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:12.535171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:12.535461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:12.537562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:12.551755 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:23:12.553250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:23:12.562081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1179/2398] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:23:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:23:19.150775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=34 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:20.395114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48191-98bd-42ed-ad78-f7fde883a7f4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:20.395904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48191-98bd-42ed-ad78-f7fde883a7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:20.395904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a48191-98bd-42ed-ad78-f7fde883a7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:20.414679 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-57a48191-98bd-42ed-ad78-f7fde883a7f4 None None] MFA Rules not processed for user `4399658c6afd4afdb0bbca33db91b80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:23:20.416249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-57a48191-98bd-42ed-ad78-f7fde883a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:20.424181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1220/2399] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:23:20.765097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:23:20.774744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef56fb-f076-4ed1-8314-5bdadb9e5735 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:23:20.778559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:23:20.779361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:20.779748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:20.780137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:20.782665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:20.793196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:23:20.794644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:23:20.803744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1180/2400] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:23:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:23:24.817692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48191-98bd-42ed-ad78-f7fde883a7f4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:23:24.834339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a48191-98bd-42ed-ad78-f7fde883a7f4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:23:24.851352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2245-441c-4e4b-987c-7b44aa6da517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:23:24.852036 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2245-441c-4e4b-987c-7b44aa6da517 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:24.852360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2245-441c-4e4b-987c-7b44aa6da517 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:24.852638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2245-441c-4e4b-987c-7b44aa6da517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:24.854550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-357b2245-441c-4e4b-987c-7b44aa6da517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:24.868969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b2245-441c-4e4b-987c-7b44aa6da517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:23:24.870783 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b2245-441c-4e4b-987c-7b44aa6da517 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:23:24.884409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1221/2401] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:23:25.027072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:23:25.053379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840dfe4-f7b8-4d63-a007-50c6aefe8e74 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:23:25.060775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee2b3-e13a-4389-9165-865388c687c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:23:25.062330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee2b3-e13a-4389-9165-865388c687c2 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:25.062791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee2b3-e13a-4389-9165-865388c687c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:25.063245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee2b3-e13a-4389-9165-865388c687c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:25.066557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6e7ee2b3-e13a-4389-9165-865388c687c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:25.103422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee2b3-e13a-4389-9165-865388c687c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:23:25.107273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee2b3-e13a-4389-9165-865388c687c2 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:23:25.136809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1181/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:23:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:23:34.878228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=9 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:35.130023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=27 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:23:39.511248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85758-fb72-4f8f-8837-84ccaebc463c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:23:39.511793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85758-fb72-4f8f-8837-84ccaebc463c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:23:39.511793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f85758-fb72-4f8f-8837-84ccaebc463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:23:39.529932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-29f85758-fb72-4f8f-8837-84ccaebc463c None None] MFA Rules not processed for user `f55c9792e2fe46cc9fc86d4c0f38f4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:23:39.531722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-29f85758-fb72-4f8f-8837-84ccaebc463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:23:39.539869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1222/2403] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:23:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:23:49.524480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:14.481495 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1f13-c7da-4323-8e35-3bc0a503544d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:24:14.482084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1f13-c7da-4323-8e35-3bc0a503544d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:24:14.482084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1f13-c7da-4323-8e35-3bc0a503544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:24:14.500867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-6bea1f13-c7da-4323-8e35-3bc0a503544d None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:24:14.502102 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6bea1f13-c7da-4323-8e35-3bc0a503544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:24:14.510697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1182/2404] 10.222.0.17 () {58 vars in 967 bytes} [Thu Jul 14 11:24:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:24:14.559146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85758-fb72-4f8f-8837-84ccaebc463c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:24:14.571081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f85758-fb72-4f8f-8837-84ccaebc463c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:24:14.576191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bd851-60c1-41e2-99cc-d8bcfa7c0e7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:24:14.576840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bd851-60c1-41e2-99cc-d8bcfa7c0e7a service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:24:14.577119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bd851-60c1-41e2-99cc-d8bcfa7c0e7a service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:24:14.577392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bd851-60c1-41e2-99cc-d8bcfa7c0e7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:24:14.586402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bd851-60c1-41e2-99cc-d8bcfa7c0e7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:24:14.587981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bd851-60c1-41e2-99cc-d8bcfa7c0e7a service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:24:14.596026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1223/2405] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:24:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:24:18.385894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1f13-c7da-4323-8e35-3bc0a503544d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:24:18.387459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6bea1f13-c7da-4323-8e35-3bc0a503544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:24:18.403445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1f13-c7da-4323-8e35-3bc0a503544d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:24:18.409881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:24:18.410689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:24:18.410978 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:24:18.411254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:24:18.413957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:24:18.429387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:24:18.431329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:24:18.453648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1183/2406] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:24:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:24:21.671864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bd851-60c1-41e2-99cc-d8bcfa7c0e7a service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:24:21.737771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bd851-60c1-41e2-99cc-d8bcfa7c0e7a service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:24:21.743133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:24:21.743949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:24:21.744273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:24:21.744548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] PATH_INFO: `/v3/users/8ed42168b1a043e39cec540c299217e5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:24:21.745724 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed42168b1a043e39cec540c299217e5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:24:21.747632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:24:21.794776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed42168b1a043e39cec540c299217e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:21.795438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed42168b1a043e39cec540c299217e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:21.802532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed42168b1a043e39cec540c299217e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:21.810237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed42168b1a043e39cec540c299217e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:21.810863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed42168b1a043e39cec540c299217e5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:21.829743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1224/2407] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:24:21 2022] DELETE /identity/v3/users/8ed42168b1a043e39cec540c299217e5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:24:22.005663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:24:22.018409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294568b-0a4f-42f4-ba11-4111245d813a service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:24:22.086322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:24:22.087123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:24:22.087482 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:24:22.087767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] PATH_INFO: `/v3/projects/be9aa426f5f64191bfd0b22e0b082edc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:24:22.089108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9aa426f5f64191bfd0b22e0b082edc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:24:22.091188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:24:22.146258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9aa426f5f64191bfd0b22e0b082edc', 'request_id': 'req-fd7e2a72-64be-40d1-95cf-0897deda10c8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.151927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9aa426f5f64191bfd0b22e0b082edc', 'request_id': 'req-fd7e2a72-64be-40d1-95cf-0897deda10c8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.160074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9aa426f5f64191bfd0b22e0b082edc', 'request_id': 'req-fd7e2a72-64be-40d1-95cf-0897deda10c8'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.172215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] The token cache is being invalidate because project be9aa426f5f64191bfd0b22e0b082edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:24:22.172506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.173160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.174706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1184/2408] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:24:22 2022] DELETE /identity/v3/projects/be9aa426f5f64191bfd0b22e0b082edc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:24:22.179254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:24:22.180746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:24:22.193796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ad2f-ee94-4cb6-ad9b-f2204c3f2d1c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:24:22.252665 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:24:22.253549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:24:22.253835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:24:22.254112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] PATH_INFO: `/v3/users/ceea44819f0543d6a2551e044622aa71` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:24:22.255308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceea44819f0543d6a2551e044622aa71)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:24:22.257270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:24:22.262581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:22.303707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceea44819f0543d6a2551e044622aa71'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.304376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceea44819f0543d6a2551e044622aa71'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.311061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceea44819f0543d6a2551e044622aa71'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.317508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceea44819f0543d6a2551e044622aa71'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.318136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceea44819f0543d6a2551e044622aa71'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.337162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1225/2409] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:24:22 2022] DELETE /identity/v3/users/ceea44819f0543d6a2551e044622aa71 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:24:22.515023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:24:22.516802 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:24:22.531136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e2a72-64be-40d1-95cf-0897deda10c8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:24:22.591452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:24:22.592262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:24:22.592544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:24:22.592812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] PATH_INFO: `/v3/projects/557e1207ab1143049926f59f91891879` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:24:22.593982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=557e1207ab1143049926f59f91891879)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:24:22.595876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:24:22.607619 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:22.642557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557e1207ab1143049926f59f91891879', 'request_id': 'req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.648698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557e1207ab1143049926f59f91891879', 'request_id': 'req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.655723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557e1207ab1143049926f59f91891879', 'request_id': 'req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.667054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] The token cache is being invalidate because project 557e1207ab1143049926f59f91891879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:24:22.667338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.667957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-426b83c6-b632-4855-8e5e-8ed2bfadbeb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:24:22.669505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1185/2410] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:24:22 2022] DELETE /identity/v3/projects/557e1207ab1143049926f59f91891879 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:24:32.333243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:24:32.664195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:02.399600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:02.401066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:02.463222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b4904-0d3b-4802-8e00-d459eb1c6155 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:02.516911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:02.517932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:02.518232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:02.518521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:02.520507 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:02.582774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:02.584245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:02.593556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1226/2411] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:12.589234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=68 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:19.773159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f090b-5984-4b5c-b292-4837411a346e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:19.773727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f090b-5984-4b5c-b292-4837411a346e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:19.773837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f090b-5984-4b5c-b292-4837411a346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:19.791351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2d1f090b-5984-4b5c-b292-4837411a346e None None] MFA Rules not processed for user `f38b26b3a2b6480ead16fb239b327d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:19.792596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2d1f090b-5984-4b5c-b292-4837411a346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:19.850131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1186/2412] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:25:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:22.623247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:22.624778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:22.691740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1837f8-85e4-4e1f-8967-969419442bed service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:22.695596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba8162-8e7b-4975-9c1e-237d0a375a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:22.696657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8162-8e7b-4975-9c1e-237d0a375a00 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:22.696774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8162-8e7b-4975-9c1e-237d0a375a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:22.697024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba8162-8e7b-4975-9c1e-237d0a375a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:22.699345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b5ba8162-8e7b-4975-9c1e-237d0a375a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:22.772822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba8162-8e7b-4975-9c1e-237d0a375a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:22.774568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba8162-8e7b-4975-9c1e-237d0a375a00 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:22.785524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1227/2413] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:26.139436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be752b2-4519-4813-a1c7-ab92d5994077 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:26.140394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be752b2-4519-4813-a1c7-ab92d5994077 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:26.140921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be752b2-4519-4813-a1c7-ab92d5994077 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:26.142621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1187/2414] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:25:26.162477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536684aa-67f3-4633-9217-654def12b11e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:26.163021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536684aa-67f3-4633-9217-654def12b11e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:26.163115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536684aa-67f3-4633-9217-654def12b11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:26.183175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-536684aa-67f3-4633-9217-654def12b11e None None] MFA Rules not processed for user `ee535097c03140178d287921bc1752b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:26.184722 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-536684aa-67f3-4633-9217-654def12b11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:26.260538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1228/2415] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:25:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:26.476185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be752b2-4519-4813-a1c7-ab92d5994077 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:26.478012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7be752b2-4519-4813-a1c7-ab92d5994077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:26.495193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be752b2-4519-4813-a1c7-ab92d5994077 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:26.500864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d89ea0-adac-4a24-8e9e-a8eb95b7cd6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:26.501507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89ea0-adac-4a24-8e9e-a8eb95b7cd6c service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:26.501795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89ea0-adac-4a24-8e9e-a8eb95b7cd6c service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:26.502079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d89ea0-adac-4a24-8e9e-a8eb95b7cd6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:26.511867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d89ea0-adac-4a24-8e9e-a8eb95b7cd6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:26.512472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d89ea0-adac-4a24-8e9e-a8eb95b7cd6c service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:26.525682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1188/2416] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:26.566899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536684aa-67f3-4633-9217-654def12b11e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:26.568803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-536684aa-67f3-4633-9217-654def12b11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:26.584926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536684aa-67f3-4633-9217-654def12b11e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:26.589715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:26.590608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:26.590889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:26.591247 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] PATH_INFO: `/v3/users/f55c9792e2fe46cc9fc86d4c0f38f4fd` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:26.593160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f55c9792e2fe46cc9fc86d4c0f38f4fd)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:26.595099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:26.637480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:26.643990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f55c9792e2fe46cc9fc86d4c0f38f4fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:26.645139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f55c9792e2fe46cc9fc86d4c0f38f4fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:26.652286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f55c9792e2fe46cc9fc86d4c0f38f4fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:26.660659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f55c9792e2fe46cc9fc86d4c0f38f4fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:26.661272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4047b7cf-cb00-4df6-8f5c-2111c5fff808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f55c9792e2fe46cc9fc86d4c0f38f4fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:26.680269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1229/2417] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:25:26 2022] DELETE /identity/v3/users/f55c9792e2fe46cc9fc86d4c0f38f4fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:25:26.860322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d89ea0-adac-4a24-8e9e-a8eb95b7cd6c service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:26.871623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d89ea0-adac-4a24-8e9e-a8eb95b7cd6c service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:26.938700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:26.939704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:26.939989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:26.940295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] PATH_INFO: `/v3/projects/4185d145c1a24e95abf745f3b3f3d4e1` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:26.941492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4185d145c1a24e95abf745f3b3f3d4e1)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:26.943393 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:27.004506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4185d145c1a24e95abf745f3b3f3d4e1', 'request_id': 'req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:27.010541 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4185d145c1a24e95abf745f3b3f3d4e1', 'request_id': 'req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:27.019623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4185d145c1a24e95abf745f3b3f3d4e1', 'request_id': 'req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:27.030625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] The token cache is being invalidate because project 4185d145c1a24e95abf745f3b3f3d4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:25:27.030919 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:27.031559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-05c8eaaf-3c06-4ecd-ac4f-d4b102438758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:25:27.033156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1189/2418] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:25:26 2022] DELETE /identity/v3/projects/4185d145c1a24e95abf745f3b3f3d4e1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:25:27.038695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22802ded-65e0-4878-869f-9b34b4c041f8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.039082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22802ded-65e0-4878-869f-9b34b4c041f8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.039435 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22802ded-65e0-4878-869f-9b34b4c041f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.061183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-22802ded-65e0-4878-869f-9b34b4c041f8 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:27.062444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-22802ded-65e0-4878-869f-9b34b4c041f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:27.129646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1230/2419] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:27.138630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff56f7-e75e-44b6-be89-3191dd322531 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.138993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff56f7-e75e-44b6-be89-3191dd322531 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.140625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff56f7-e75e-44b6-be89-3191dd322531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.161214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-11ff56f7-e75e-44b6-be89-3191dd322531 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:27.162525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-11ff56f7-e75e-44b6-be89-3191dd322531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:27.172606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1190/2420] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:27.176682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22802ded-65e0-4878-869f-9b34b4c041f8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:27.187826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22802ded-65e0-4878-869f-9b34b4c041f8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:27.192517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:27.193183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.193467 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.193745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.194478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:25:27.194784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:27.196439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:27.212360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1231/2421] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:25:27.213774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff56f7-e75e-44b6-be89-3191dd322531 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:27.223985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff56f7-e75e-44b6-be89-3191dd322531 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:27.228745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c318f7f-4e2b-4800-a884-bc1c2635498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:27.229499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318f7f-4e2b-4800-a884-bc1c2635498f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.229852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318f7f-4e2b-4800-a884-bc1c2635498f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.230133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c318f7f-4e2b-4800-a884-bc1c2635498f admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.230912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c318f7f-4e2b-4800-a884-bc1c2635498f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:27.232815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c318f7f-4e2b-4800-a884-bc1c2635498f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:27.246060 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:27.260154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1191/2422] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:25:27 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:25:27.264444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:27.277618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941556a1-c182-447f-8b25-aee397ecb0e6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:27.338446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba74e5f-24a2-457d-a330-a5e6b6149164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:27.339125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74e5f-24a2-457d-a330-a5e6b6149164 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.339411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74e5f-24a2-457d-a330-a5e6b6149164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.339689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba74e5f-24a2-457d-a330-a5e6b6149164 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.340429 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba74e5f-24a2-457d-a330-a5e6b6149164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:27.342990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba74e5f-24a2-457d-a330-a5e6b6149164 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:27.384483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1232/2423] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:25:27 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:25:27.389037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c318f7f-4e2b-4800-a884-bc1c2635498f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:27.401764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c318f7f-4e2b-4800-a884-bc1c2635498f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:27.407566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278b2c7-5347-4019-b576-c36d6574cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:27.408265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b2c7-5347-4019-b576-c36d6574cefc admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.408547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b2c7-5347-4019-b576-c36d6574cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.408818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278b2c7-5347-4019-b576-c36d6574cefc admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.409542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278b2c7-5347-4019-b576-c36d6574cefc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:27.411138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278b2c7-5347-4019-b576-c36d6574cefc admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:27.422911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1192/2424] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:25:27.427005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba74e5f-24a2-457d-a330-a5e6b6149164 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:27.437813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba74e5f-24a2-457d-a330-a5e6b6149164 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:27.442870 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa3d25-3111-4c36-a9cb-78df77784a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:27.443787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa3d25-3111-4c36-a9cb-78df77784a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.444240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa3d25-3111-4c36-a9cb-78df77784a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.444520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa3d25-3111-4c36-a9cb-78df77784a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.445245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa3d25-3111-4c36-a9cb-78df77784a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:27.446872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa3d25-3111-4c36-a9cb-78df77784a6f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:27.458080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1233/2425] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:25:27.462388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278b2c7-5347-4019-b576-c36d6574cefc admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:27.519886 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278b2c7-5347-4019-b576-c36d6574cefc admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:27.524574 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:27.525460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.525739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.526014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] PATH_INFO: `/v3/projects/587165be6b2844c79154d471533b115c/users/f1ad883ea911405c847e8f166a6dfe4e/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.540406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] RBAC: Authorizing `identity:create_grant(project_id=587165be6b2844c79154d471533b115c, user_id=f1ad883ea911405c847e8f166a6dfe4e, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:27.543039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:27.555928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1193/2426] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:25:27 2022] PUT /identity/v3/projects/587165be6b2844c79154d471533b115c/users/f1ad883ea911405c847e8f166a6dfe4e/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:25:27.561719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26753-3a69-44de-b0f6-eb4ab4f3396d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.562007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26753-3a69-44de-b0f6-eb4ab4f3396d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.562283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b26753-3a69-44de-b0f6-eb4ab4f3396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.568993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:27.592610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e6b26753-3a69-44de-b0f6-eb4ab4f3396d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:27.594155 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e6b26753-3a69-44de-b0f6-eb4ab4f3396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:27.654921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1234/2427] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:27.664503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:27.666212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:27.734150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3d25-5a94-4215-b175-6db220d2731d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:27.738107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ea89e-1b8a-4854-ae10-b55f58bf79b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:27.738765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea89e-1b8a-4854-ae10-b55f58bf79b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:27.739047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea89e-1b8a-4854-ae10-b55f58bf79b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:27.739321 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ea89e-1b8a-4854-ae10-b55f58bf79b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:27.748700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ea89e-1b8a-4854-ae10-b55f58bf79b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:27.750157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ea89e-1b8a-4854-ae10-b55f58bf79b5 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:27.759587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1194/2428] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:30.870652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b26753-3a69-44de-b0f6-eb4ab4f3396d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:30.874052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e6b26753-3a69-44de-b0f6-eb4ab4f3396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:31.069840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b26753-3a69-44de-b0f6-eb4ab4f3396d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:31.076814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:31.077199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:31.077392 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:31.077670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:31.079703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:31.094635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:31.096729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:31.109279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1235/2429] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:25:32.206959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5b83-0af4-4760-a962-0e0baf372f7b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:32.207599 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5b83-0af4-4760-a962-0e0baf372f7b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:32.207789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5b83-0af4-4760-a962-0e0baf372f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:32.240981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e8eb5b83-0af4-4760-a962-0e0baf372f7b None None] MFA Rules not processed for user `f1ad883ea911405c847e8f166a6dfe4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:32.242332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e8eb5b83-0af4-4760-a962-0e0baf372f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:32.328888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1195/2430] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:25:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:32.343732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:32.357829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66561b6-9956-4b17-b62d-02cfb6662a91 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:32.373280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a42049-f32e-4708-b3a3-24fdb5bb7492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:32.374067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42049-f32e-4708-b3a3-24fdb5bb7492 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:32.374426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42049-f32e-4708-b3a3-24fdb5bb7492 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:32.375451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a42049-f32e-4708-b3a3-24fdb5bb7492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:32.400422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a42049-f32e-4708-b3a3-24fdb5bb7492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:32.404974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a42049-f32e-4708-b3a3-24fdb5bb7492 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:32.415661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1236/2431] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:33.953223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760a2c-d301-4173-bb7f-5cf54ef4c309 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:33.953751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760a2c-d301-4173-bb7f-5cf54ef4c309 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:33.954011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760a2c-d301-4173-bb7f-5cf54ef4c309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:33.961311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:33.980252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ff760a2c-d301-4173-bb7f-5cf54ef4c309 None None] MFA Rules not processed for user `f1ad883ea911405c847e8f166a6dfe4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:33.981519 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ff760a2c-d301-4173-bb7f-5cf54ef4c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:33.989208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1196/2432] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:25:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:41.324844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846855d-ca8d-4219-9860-ecdaf30755a2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:41.325340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846855d-ca8d-4219-9860-ecdaf30755a2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:41.325641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846855d-ca8d-4219-9860-ecdaf30755a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:41.357173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0846855d-ca8d-4219-9860-ecdaf30755a2 None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:41.358416 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0846855d-ca8d-4219-9860-ecdaf30755a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:41.384306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:41.415744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1237/2433] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:25:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:41.464465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff760a2c-d301-4173-bb7f-5cf54ef4c309 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:41.466054 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ff760a2c-d301-4173-bb7f-5cf54ef4c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:41.550579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff760a2c-d301-4173-bb7f-5cf54ef4c309 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:41.555514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f7e0a-490b-4d32-9cf3-da9b6c9409f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:41.556202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7e0a-490b-4d32-9cf3-da9b6c9409f5 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:41.556487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7e0a-490b-4d32-9cf3-da9b6c9409f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:41.556763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f7e0a-490b-4d32-9cf3-da9b6c9409f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:41.565420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f7e0a-490b-4d32-9cf3-da9b6c9409f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:41.566964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f7e0a-490b-4d32-9cf3-da9b6c9409f5 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:41.576485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1197/2434] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:25:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:25:51.408902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=12 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:51.572078 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=34 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:25:54.394009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846855d-ca8d-4219-9860-ecdaf30755a2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:54.395418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0846855d-ca8d-4219-9860-ecdaf30755a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:54.488248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846855d-ca8d-4219-9860-ecdaf30755a2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:54.494510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41a5ed-91d9-4336-b8b4-f1131ffb8b46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:54.495272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a5ed-91d9-4336-b8b4-f1131ffb8b46 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:54.495636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a5ed-91d9-4336-b8b4-f1131ffb8b46 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:54.496028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a5ed-91d9-4336-b8b4-f1131ffb8b46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:54.498061 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6a41a5ed-91d9-4336-b8b4-f1131ffb8b46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:54.510304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41a5ed-91d9-4336-b8b4-f1131ffb8b46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:54.511880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41a5ed-91d9-4336-b8b4-f1131ffb8b46 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:54.527418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1238/2435] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:56.547081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf89e-7be8-4197-905f-e2ee2d9a0001 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:56.547633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf89e-7be8-4197-905f-e2ee2d9a0001 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:56.547633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cf89e-7be8-4197-905f-e2ee2d9a0001 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:56.549072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1198/2436] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:25:56.555388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f377-56f7-4f92-bf09-5db9287464f6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:56.555910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f377-56f7-4f92-bf09-5db9287464f6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:56.556030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68f377-56f7-4f92-bf09-5db9287464f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:56.584876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ad68f377-56f7-4f92-bf09-5db9287464f6 None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:56.586084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ad68f377-56f7-4f92-bf09-5db9287464f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:56.595357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1239/2437] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:25:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:56.607013 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cf89e-7be8-4197-905f-e2ee2d9a0001 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:56.610540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0b5cf89e-7be8-4197-905f-e2ee2d9a0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:56.671480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cf89e-7be8-4197-905f-e2ee2d9a0001 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:56.675188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0be3e-9cd7-4261-8577-2e1b09ddffec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c97bd14230147a5bd004c71f5387098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:56.685082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0be3e-9cd7-4261-8577-2e1b09ddffec service glance] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:56.685082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0be3e-9cd7-4261-8577-2e1b09ddffec service glance] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:56.685082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0be3e-9cd7-4261-8577-2e1b09ddffec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:56.687665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0be3e-9cd7-4261-8577-2e1b09ddffec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:56.689286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0be3e-9cd7-4261-8577-2e1b09ddffec service glance] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:56.699987 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1199/2438] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:56.768447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949bf01-c8bb-4e96-9a50-fa130c7df241 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:56.768739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949bf01-c8bb-4e96-9a50-fa130c7df241 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:56.769025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949bf01-c8bb-4e96-9a50-fa130c7df241 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:56.770419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1240/2439] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:25:56.775201 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71436c77-8f29-4d16-a946-036f3e04f157 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:56.775491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71436c77-8f29-4d16-a946-036f3e04f157 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:56.775768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71436c77-8f29-4d16-a946-036f3e04f157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:56.805521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-71436c77-8f29-4d16-a946-036f3e04f157 None None] MFA Rules not processed for user `a367d904a4a44e91862da4aea28a123b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:56.806714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-71436c77-8f29-4d16-a946-036f3e04f157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:56.822166 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1200/2440] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:25:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:56.834118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949bf01-c8bb-4e96-9a50-fa130c7df241 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:56.845650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949bf01-c8bb-4e96-9a50-fa130c7df241 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:56.849130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd77872-b7a9-4d16-8ddd-e517b667ce3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:56.849761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd77872-b7a9-4d16-8ddd-e517b667ce3d service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:56.850042 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd77872-b7a9-4d16-8ddd-e517b667ce3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:56.850315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd77872-b7a9-4d16-8ddd-e517b667ce3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:56.857750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd77872-b7a9-4d16-8ddd-e517b667ce3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:56.859733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd77872-b7a9-4d16-8ddd-e517b667ce3d service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:56.867372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1241/2441] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:56.952825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a332e-a00d-4e38-a313-827afb7bb844 None None] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:56.953145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a332e-a00d-4e38-a313-827afb7bb844 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:56.953448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a332e-a00d-4e38-a313-827afb7bb844 None None] PATH_INFO: `/` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:56.954828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1201/2442] 10.222.0.17 () {54 vars in 921 bytes} [Thu Jul 14 11:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 11:25:56.960758 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7707-b1d6-4432-9fe4-d6b312e2aadf None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:56.961048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7707-b1d6-4432-9fe4-d6b312e2aadf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:56.961326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e7707-b1d6-4432-9fe4-d6b312e2aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:56.980194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-328e7707-b1d6-4432-9fe4-d6b312e2aadf None None] MFA Rules not processed for user `00b59b80b61a4dec8f4df2bc8a45d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:56.981426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-328e7707-b1d6-4432-9fe4-d6b312e2aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:56.991409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1242/2443] 10.222.0.17 () {58 vars in 1018 bytes} [Thu Jul 14 11:25:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:57.001951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a332e-a00d-4e38-a313-827afb7bb844 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:57.013301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a332e-a00d-4e38-a313-827afb7bb844 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:57.017456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5df74e-baae-4539-99c9-e800737a0eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:57.018096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df74e-baae-4539-99c9-e800737a0eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:57.018380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df74e-baae-4539-99c9-e800737a0eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:57.018657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5df74e-baae-4539-99c9-e800737a0eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:57.029528 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5df74e-baae-4539-99c9-e800737a0eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:57.031594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5df74e-baae-4539-99c9-e800737a0eb0 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:57.042347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1202/2444] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:25:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:25:58.640348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43441-36d4-49a4-a583-40b8cc61d1ea None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:58.640838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43441-36d4-49a4-a583-40b8cc61d1ea None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:58.640945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd43441-36d4-49a4-a583-40b8cc61d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:58.660285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1dd43441-36d4-49a4-a583-40b8cc61d1ea None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:25:58.661532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1dd43441-36d4-49a4-a583-40b8cc61d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:25:58.668791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1243/2445] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:25:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:25:58.681250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5df74e-baae-4539-99c9-e800737a0eb0 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:25:58.693651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5df74e-baae-4539-99c9-e800737a0eb0 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:25:58.698633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6e73-4109-4f0a-97eb-28dd57fd2fa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:25:58.699268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6e73-4109-4f0a-97eb-28dd57fd2fa5 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:25:58.699550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6e73-4109-4f0a-97eb-28dd57fd2fa5 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:25:58.699824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a6e73-4109-4f0a-97eb-28dd57fd2fa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:25:58.714836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a6e73-4109-4f0a-97eb-28dd57fd2fa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:25:58.716480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a6e73-4109-4f0a-97eb-28dd57fd2fa5 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:25:58.724640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1203/2446] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:25:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:26:08.653569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=60 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:08.721311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=50 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:20.580125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5a86-9386-469f-989d-33201a830900 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:26:20.580581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5a86-9386-469f-989d-33201a830900 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:26:20.580859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b5a86-9386-469f-989d-33201a830900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:26:20.599318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d16b5a86-9386-469f-989d-33201a830900 None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:26:20.600565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d16b5a86-9386-469f-989d-33201a830900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:26:20.607655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1244/2447] 10.222.0.17 () {58 vars in 967 bytes} [Thu Jul 14 11:26:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:26:20.619615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6e73-4109-4f0a-97eb-28dd57fd2fa5 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:26:20.630916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a6e73-4109-4f0a-97eb-28dd57fd2fa5 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:26:20.636074 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:26:20.636748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:26:20.637035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:26:20.637316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:26:20.646139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:26:20.647726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:26:20.655710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1204/2448] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:26:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 11:26:30.594293 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:26:30.652512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:19.955412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5a86-9386-469f-989d-33201a830900 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:19.957109 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d16b5a86-9386-469f-989d-33201a830900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:19.969231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b5a86-9386-469f-989d-33201a830900 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:19.973628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:19.974277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:19.974559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:19.974833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:19.976801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:19.989504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:19.990928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:20.001739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1245/2449] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:23.325206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:23.326771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:23.344449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd396-c0d7-4e58-be67-63976be42c87 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:23.349763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:23.350865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:23.351131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:23.351404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] PATH_INFO: `/v3/users/f38b26b3a2b6480ead16fb239b327d1f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:23.352631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38b26b3a2b6480ead16fb239b327d1f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:23.355287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:23.406557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38b26b3a2b6480ead16fb239b327d1f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.407306 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38b26b3a2b6480ead16fb239b327d1f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.419766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38b26b3a2b6480ead16fb239b327d1f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.420448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38b26b3a2b6480ead16fb239b327d1f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.428126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5d15f1a4-09d6-43c6-ad0c-d4e0df9c906a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38b26b3a2b6480ead16fb239b327d1f'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.441822 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1205/2450] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:23 2022] DELETE /identity/v3/users/f38b26b3a2b6480ead16fb239b327d1f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:23.624688 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:23.635331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852752b2-d3c2-44d9-b6da-a2d67ef7378c service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:23.698671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:23.699534 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:23.699814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:23.700086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] PATH_INFO: `/v3/projects/b01e295c30494db9a4386e871e6d9dcc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:23.701280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01e295c30494db9a4386e871e6d9dcc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:23.703190 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:23.749253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01e295c30494db9a4386e871e6d9dcc', 'request_id': 'req-5fb399f8-2ff8-474e-9a42-967eea43c53c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.755108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01e295c30494db9a4386e871e6d9dcc', 'request_id': 'req-5fb399f8-2ff8-474e-9a42-967eea43c53c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.762447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01e295c30494db9a4386e871e6d9dcc', 'request_id': 'req-5fb399f8-2ff8-474e-9a42-967eea43c53c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.772716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] The token cache is being invalidate because project b01e295c30494db9a4386e871e6d9dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:23.772988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.773618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5fb399f8-2ff8-474e-9a42-967eea43c53c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:23.775163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1246/2451] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:23 2022] DELETE /identity/v3/projects/b01e295c30494db9a4386e871e6d9dcc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:23.780688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510704-59b1-4416-bb32-e960b0fe7a66 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:23.780957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510704-59b1-4416-bb32-e960b0fe7a66 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:23.781235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16510704-59b1-4416-bb32-e960b0fe7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:23.818189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-16510704-59b1-4416-bb32-e960b0fe7a66 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:23.819398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-16510704-59b1-4416-bb32-e960b0fe7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:23.880542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1206/2452] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:23.888619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1884-542c-4617-9b4e-d2f4b57ae177 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:23.888957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1884-542c-4617-9b4e-d2f4b57ae177 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:23.889239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1884-542c-4617-9b4e-d2f4b57ae177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:23.907720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-00be1884-542c-4617-9b4e-d2f4b57ae177 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:23.908968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-00be1884-542c-4617-9b4e-d2f4b57ae177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:23.917922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1247/2453] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:23.922158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510704-59b1-4416-bb32-e960b0fe7a66 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:23.931653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16510704-59b1-4416-bb32-e960b0fe7a66 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:23.936239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:23.936884 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:23.937165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:23.937438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:23.938158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:27:23.938460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:23.940043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:23.953824 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1207/2454] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:27:23.958417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1884-542c-4617-9b4e-d2f4b57ae177 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:23.968334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1884-542c-4617-9b4e-d2f4b57ae177 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:23.972977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95988f86-7b70-4f6c-b90e-40a00ee56e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:23.973627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988f86-7b70-4f6c-b90e-40a00ee56e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:23.973911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988f86-7b70-4f6c-b90e-40a00ee56e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:23.974189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95988f86-7b70-4f6c-b90e-40a00ee56e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:23.974885 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95988f86-7b70-4f6c-b90e-40a00ee56e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:23.976847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95988f86-7b70-4f6c-b90e-40a00ee56e49 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:24.002152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1248/2455] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:23 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:24.006177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:24.016037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56685f0-dfa8-4df2-bc44-d93e88c83309 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:24.058815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:24.077408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034620-cf85-439d-ab5f-4e599f2d751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:24.078095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034620-cf85-439d-ab5f-4e599f2d751a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:24.078381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034620-cf85-439d-ab5f-4e599f2d751a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:24.078658 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034620-cf85-439d-ab5f-4e599f2d751a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:24.079364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65034620-cf85-439d-ab5f-4e599f2d751a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:24.081317 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65034620-cf85-439d-ab5f-4e599f2d751a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:24.102690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1208/2456] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:24 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:24.107577 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95988f86-7b70-4f6c-b90e-40a00ee56e49 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:24.117993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95988f86-7b70-4f6c-b90e-40a00ee56e49 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:24.126934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae15886-fdcc-42a0-8e16-2ce11d55b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:24.127746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae15886-fdcc-42a0-8e16-2ce11d55b0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:24.128130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae15886-fdcc-42a0-8e16-2ce11d55b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:24.128480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae15886-fdcc-42a0-8e16-2ce11d55b0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:24.129326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae15886-fdcc-42a0-8e16-2ce11d55b0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:24.131097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae15886-fdcc-42a0-8e16-2ce11d55b0d3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:24.146193 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1249/2457] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:24.147735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034620-cf85-439d-ab5f-4e599f2d751a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:24.159603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034620-cf85-439d-ab5f-4e599f2d751a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:24.164672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829e46-b81b-47e7-8f75-4bc590a7e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:24.165433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829e46-b81b-47e7-8f75-4bc590a7e2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:24.165683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829e46-b81b-47e7-8f75-4bc590a7e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:24.165969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829e46-b81b-47e7-8f75-4bc590a7e2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:24.166720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829e46-b81b-47e7-8f75-4bc590a7e2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:24.168365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829e46-b81b-47e7-8f75-4bc590a7e2f3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:24.181268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1209/2458] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:27:24.185611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae15886-fdcc-42a0-8e16-2ce11d55b0d3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:24.195822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae15886-fdcc-42a0-8e16-2ce11d55b0d3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:24.201542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:24.202444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:24.202731 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:24.203010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] PATH_INFO: `/v3/projects/208d93a924c04a9aa230d0dde6449f0f/users/ba5151e37754468b9b961469906e0dbd/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:24.218976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] RBAC: Authorizing `identity:create_grant(project_id=208d93a924c04a9aa230d0dde6449f0f, user_id=ba5151e37754468b9b961469906e0dbd, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:24.221792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:24.238867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1250/2459] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:24 2022] PUT /identity/v3/projects/208d93a924c04a9aa230d0dde6449f0f/users/ba5151e37754468b9b961469906e0dbd/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:24.250498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d8e4-5675-4cf7-8eba-05b4ee2e51c0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:24.250793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d8e4-5675-4cf7-8eba-05b4ee2e51c0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:24.251105 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649d8e4-5675-4cf7-8eba-05b4ee2e51c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:24.282623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e649d8e4-5675-4cf7-8eba-05b4ee2e51c0 None None] MFA Rules not processed for user `ba5151e37754468b9b961469906e0dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:24.283763 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e649d8e4-5675-4cf7-8eba-05b4ee2e51c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:24.351524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1210/2460] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:24.363251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:24.365797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:24.384971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:24.457352 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c014dd-1b65-406b-91c0-4196d7b2517b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:24.464737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758576c-f576-4a92-9633-4f7cadaca486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:24.465542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758576c-f576-4a92-9633-4f7cadaca486 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:24.465934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758576c-f576-4a92-9633-4f7cadaca486 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:24.466343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758576c-f576-4a92-9633-4f7cadaca486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:24.475645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758576c-f576-4a92-9633-4f7cadaca486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:24.477335 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758576c-f576-4a92-9633-4f7cadaca486 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:24.487789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1251/2461] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:29.674960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d8e4-5675-4cf7-8eba-05b4ee2e51c0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:29.742801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649d8e4-5675-4cf7-8eba-05b4ee2e51c0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:29.747657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:29.748593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:29.748874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:29.749149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] PATH_INFO: `/v3/users/ba5151e37754468b9b961469906e0dbd` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:29.750522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5151e37754468b9b961469906e0dbd)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:29.752693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:29.806152 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5151e37754468b9b961469906e0dbd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:29.806715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5151e37754468b9b961469906e0dbd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:29.812134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:29.820927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5151e37754468b9b961469906e0dbd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:29.821750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5151e37754468b9b961469906e0dbd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:29.828961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5151e37754468b9b961469906e0dbd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:29.841918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1211/2462] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:29 2022] DELETE /identity/v3/users/ba5151e37754468b9b961469906e0dbd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:29.846486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e51a5-d981-4a6f-ac34-c22768f18d93 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:29.846986 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e51a5-d981-4a6f-ac34-c22768f18d93 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:29.847085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e51a5-d981-4a6f-ac34-c22768f18d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:29.866672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d28e51a5-d981-4a6f-ac34-c22768f18d93 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:29.868205 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d28e51a5-d981-4a6f-ac34-c22768f18d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:29.929203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1252/2463] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:29.939216 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:29.941011 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:30.007840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98062775-b13a-45a7-a74f-e158cecce07d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:30.011976 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dea18-5941-426a-9bf3-5b24290a20a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:30.012700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dea18-5941-426a-9bf3-5b24290a20a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:30.012985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dea18-5941-426a-9bf3-5b24290a20a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:30.013267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dea18-5941-426a-9bf3-5b24290a20a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:30.024904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dea18-5941-426a-9bf3-5b24290a20a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:30.026959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dea18-5941-426a-9bf3-5b24290a20a9 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:30.038325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1212/2464] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:30.565083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e51a5-d981-4a6f-ac34-c22768f18d93 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:30.566540 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d28e51a5-d981-4a6f-ac34-c22768f18d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:30.581430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e51a5-d981-4a6f-ac34-c22768f18d93 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:30.589152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:30.590091 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:30.590373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:30.590651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] PATH_INFO: `/v3/projects/208d93a924c04a9aa230d0dde6449f0f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:30.592936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=208d93a924c04a9aa230d0dde6449f0f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:30.595146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:30.653709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208d93a924c04a9aa230d0dde6449f0f', 'request_id': 'req-4e739a13-c80b-4722-a82d-faec8643f3ed'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:30.660492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208d93a924c04a9aa230d0dde6449f0f', 'request_id': 'req-4e739a13-c80b-4722-a82d-faec8643f3ed'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:30.670273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208d93a924c04a9aa230d0dde6449f0f', 'request_id': 'req-4e739a13-c80b-4722-a82d-faec8643f3ed'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:30.682382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] The token cache is being invalidate because project 208d93a924c04a9aa230d0dde6449f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:30.683240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:30.683915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4e739a13-c80b-4722-a82d-faec8643f3ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:30.685684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1253/2465] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:30 2022] DELETE /identity/v3/projects/208d93a924c04a9aa230d0dde6449f0f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:30.691482 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578be46-ff43-4513-b817-0afafa0df04c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:30.692063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578be46-ff43-4513-b817-0afafa0df04c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:30.692391 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578be46-ff43-4513-b817-0afafa0df04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:30.717560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3578be46-ff43-4513-b817-0afafa0df04c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:30.718806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3578be46-ff43-4513-b817-0afafa0df04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:30.804386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1213/2466] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:27:30.814417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd91e-66c2-432d-be26-da94d273ad98 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:30.814908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd91e-66c2-432d-be26-da94d273ad98 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:30.815402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd91e-66c2-432d-be26-da94d273ad98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:30.848074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8d0dd91e-66c2-432d-be26-da94d273ad98 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:30.850105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8d0dd91e-66c2-432d-be26-da94d273ad98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:30.869550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1254/2467] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:27:30.872322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578be46-ff43-4513-b817-0afafa0df04c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:30.887102 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578be46-ff43-4513-b817-0afafa0df04c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:30.893697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:30.894603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:30.894995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:30.895377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:30.896328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:27:30.896746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:30.898613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:30.919842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1214/2468] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:27:30.921242 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dd91e-66c2-432d-be26-da94d273ad98 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:30.931043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dd91e-66c2-432d-be26-da94d273ad98 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:30.940399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd32e0-e4c9-426e-8716-27922ab878e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:30.941180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd32e0-e4c9-426e-8716-27922ab878e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:30.941471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd32e0-e4c9-426e-8716-27922ab878e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:30.941749 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd32e0-e4c9-426e-8716-27922ab878e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:30.942522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd32e0-e4c9-426e-8716-27922ab878e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:30.944580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd32e0-e4c9-426e-8716-27922ab878e8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:30.961775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:30.986297 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1255/2469] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:30 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:30.991200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.008527 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da62dc9-f76c-478c-89dd-b11d2d3c83e8 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.095633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868b3fc-0fcd-46c9-8a49-a4f5b2f87420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.096622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b3fc-0fcd-46c9-8a49-a4f5b2f87420 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.097005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b3fc-0fcd-46c9-8a49-a4f5b2f87420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.097339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b3fc-0fcd-46c9-8a49-a4f5b2f87420 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.098344 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868b3fc-0fcd-46c9-8a49-a4f5b2f87420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.100871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868b3fc-0fcd-46c9-8a49-a4f5b2f87420 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.113151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:31.140186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1215/2470] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:30 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:31.141337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd32e0-e4c9-426e-8716-27922ab878e8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.153465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd32e0-e4c9-426e-8716-27922ab878e8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.159016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b2659-917f-438a-be46-a4fce4101aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.159713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2659-917f-438a-be46-a4fce4101aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.160067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2659-917f-438a-be46-a4fce4101aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.160376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2659-917f-438a-be46-a4fce4101aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.161134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b2659-917f-438a-be46-a4fce4101aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.163207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b2659-917f-438a-be46-a4fce4101aa1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.177910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1256/2471] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:31.181861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868b3fc-0fcd-46c9-8a49-a4f5b2f87420 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.194628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868b3fc-0fcd-46c9-8a49-a4f5b2f87420 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.199695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84fd8d-8af3-41fb-b232-6ac50a60df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.200433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84fd8d-8af3-41fb-b232-6ac50a60df26 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.200715 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84fd8d-8af3-41fb-b232-6ac50a60df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.200993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84fd8d-8af3-41fb-b232-6ac50a60df26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.201732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84fd8d-8af3-41fb-b232-6ac50a60df26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.203509 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84fd8d-8af3-41fb-b232-6ac50a60df26 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.217724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1216/2472] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:27:31.223218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b2659-917f-438a-be46-a4fce4101aa1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.248334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b2659-917f-438a-be46-a4fce4101aa1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.248334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6c390-91f2-40ec-8390-0f5d4f7a0956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.248334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6c390-91f2-40ec-8390-0f5d4f7a0956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.248334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6c390-91f2-40ec-8390-0f5d4f7a0956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.249000 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6c390-91f2-40ec-8390-0f5d4f7a0956 admin admin] PATH_INFO: `/v3/projects/ac3af36a390544db86d8a099a19291ef/users/28591ed777f146c9abba96201c3a06a3/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.265428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6c390-91f2-40ec-8390-0f5d4f7a0956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3af36a390544db86d8a099a19291ef, user_id=28591ed777f146c9abba96201c3a06a3, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.268126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6c390-91f2-40ec-8390-0f5d4f7a0956 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.283418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1257/2473] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:31 2022] PUT /identity/v3/projects/ac3af36a390544db86d8a099a19291ef/users/28591ed777f146c9abba96201c3a06a3/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:31.294163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560073b-2680-465a-b980-b592f3850a58 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.294529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560073b-2680-465a-b980-b592f3850a58 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.294879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560073b-2680-465a-b980-b592f3850a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.323876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4560073b-2680-465a-b980-b592f3850a58 None None] MFA Rules not processed for user `28591ed777f146c9abba96201c3a06a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:31.325282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4560073b-2680-465a-b980-b592f3850a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:31.404529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1217/2474] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:27:31.409168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6c390-91f2-40ec-8390-0f5d4f7a0956 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.580863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6c390-91f2-40ec-8390-0f5d4f7a0956 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.601974 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87dc50-6537-457c-8a57-da6b4e55ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.603514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dc50-6537-457c-8a57-da6b4e55ba48 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.604426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dc50-6537-457c-8a57-da6b4e55ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.608198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87dc50-6537-457c-8a57-da6b4e55ba48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.609574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87dc50-6537-457c-8a57-da6b4e55ba48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.611675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87dc50-6537-457c-8a57-da6b4e55ba48 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.652561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1258/2475] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:31 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:31.652995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560073b-2680-465a-b980-b592f3850a58 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.666441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560073b-2680-465a-b980-b592f3850a58 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.730454 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5541003-a01f-46cd-b9b3-f7dcfe727399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.731273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541003-a01f-46cd-b9b3-f7dcfe727399 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.731565 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541003-a01f-46cd-b9b3-f7dcfe727399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.731845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5541003-a01f-46cd-b9b3-f7dcfe727399 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.732582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5541003-a01f-46cd-b9b3-f7dcfe727399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.734737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5541003-a01f-46cd-b9b3-f7dcfe727399 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.755840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1218/2476] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:31 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:31.759852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87dc50-6537-457c-8a57-da6b4e55ba48 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.778953 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87dc50-6537-457c-8a57-da6b4e55ba48 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.783915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e1423-902d-4d7b-96a1-7820b0ca2198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.784643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1423-902d-4d7b-96a1-7820b0ca2198 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.784925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1423-902d-4d7b-96a1-7820b0ca2198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.785209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e1423-902d-4d7b-96a1-7820b0ca2198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.785933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e1423-902d-4d7b-96a1-7820b0ca2198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.787539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e1423-902d-4d7b-96a1-7820b0ca2198 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.798552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1259/2477] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:31.802747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5541003-a01f-46cd-b9b3-f7dcfe727399 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.813617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5541003-a01f-46cd-b9b3-f7dcfe727399 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.818722 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34214-0fa3-4109-ab7d-779ac4301f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.819810 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34214-0fa3-4109-ab7d-779ac4301f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.820120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34214-0fa3-4109-ab7d-779ac4301f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.820404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad34214-0fa3-4109-ab7d-779ac4301f7f admin admin] PATH_INFO: `/v3/projects/1aa4e0d6aaac43c08a6a8145cda94a09/users/10f3d62baecd4ba48705b4d15c39bc2a/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.840669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad34214-0fa3-4109-ab7d-779ac4301f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa4e0d6aaac43c08a6a8145cda94a09, user_id=10f3d62baecd4ba48705b4d15c39bc2a, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.844000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad34214-0fa3-4109-ab7d-779ac4301f7f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.860272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1219/2478] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:31 2022] PUT /identity/v3/projects/1aa4e0d6aaac43c08a6a8145cda94a09/users/10f3d62baecd4ba48705b4d15c39bc2a/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:31.865422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e1423-902d-4d7b-96a1-7820b0ca2198 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.876263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e1423-902d-4d7b-96a1-7820b0ca2198 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.942561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07d9f7-d928-41f3-bf5a-4eb4ff1735a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.943256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07d9f7-d928-41f3-bf5a-4eb4ff1735a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.943542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07d9f7-d928-41f3-bf5a-4eb4ff1735a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.943823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07d9f7-d928-41f3-bf5a-4eb4ff1735a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.944825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07d9f7-d928-41f3-bf5a-4eb4ff1735a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.946581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07d9f7-d928-41f3-bf5a-4eb4ff1735a9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:31.962441 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1260/2479] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:31.963965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34214-0fa3-4109-ab7d-779ac4301f7f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:31.977782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad34214-0fa3-4109-ab7d-779ac4301f7f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:31.983047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:31.984027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:31.984349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:31.984624 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] PATH_INFO: `/v3/projects/1aa4e0d6aaac43c08a6a8145cda94a09/users/10f3d62baecd4ba48705b4d15c39bc2a/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:31.986650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa4e0d6aaac43c08a6a8145cda94a09, user_id=10f3d62baecd4ba48705b4d15c39bc2a, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:31.989494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:32.001153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1220/2480] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:31 2022] PUT /identity/v3/projects/1aa4e0d6aaac43c08a6a8145cda94a09/users/10f3d62baecd4ba48705b4d15c39bc2a/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:32.013240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac3c6-9875-4d50-bf06-ecf12cc943fe None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:32.013437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac3c6-9875-4d50-bf06-ecf12cc943fe None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:32.013653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac3c6-9875-4d50-bf06-ecf12cc943fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:32.039936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6d2ac3c6-9875-4d50-bf06-ecf12cc943fe None None] MFA Rules not processed for user `10f3d62baecd4ba48705b4d15c39bc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:32.041223 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6d2ac3c6-9875-4d50-bf06-ecf12cc943fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:32.060767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:32.121005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1261/2481] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:32.132394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:32.134210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:32.162607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:32.224531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580884c-381a-44a5-bd6a-f8a74a43348d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:32.228677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:32.229358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:32.229636 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:32.229910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:32.301593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:32.305378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:32.316617 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1221/2482] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:33.759019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac3c6-9875-4d50-bf06-ecf12cc943fe None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:33.760439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6d2ac3c6-9875-4d50-bf06-ecf12cc943fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:33.772836 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac3c6-9875-4d50-bf06-ecf12cc943fe None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:33.776434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5cc27-8847-4655-a9e3-c7f4884471a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:33.777080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5cc27-8847-4655-a9e3-c7f4884471a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:33.777363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5cc27-8847-4655-a9e3-c7f4884471a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:33.777639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5cc27-8847-4655-a9e3-c7f4884471a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:33.786916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5cc27-8847-4655-a9e3-c7f4884471a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:33.788390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5cc27-8847-4655-a9e3-c7f4884471a4 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:33.798860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1262/2483] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:35.469974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:35.471444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:35.528605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86269a5f-b4a6-4862-a910-46659a5adeb4 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:35.532523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212267b9-b6d0-45e6-b2cd-53f0d1c738ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:35.533178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212267b9-b6d0-45e6-b2cd-53f0d1c738ae service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:35.533490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212267b9-b6d0-45e6-b2cd-53f0d1c738ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:35.533766 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212267b9-b6d0-45e6-b2cd-53f0d1c738ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:35.535539 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-212267b9-b6d0-45e6-b2cd-53f0d1c738ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:35.599367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212267b9-b6d0-45e6-b2cd-53f0d1c738ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:35.601285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212267b9-b6d0-45e6-b2cd-53f0d1c738ae service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:35.611947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1222/2484] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:37.578619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5cc27-8847-4655-a9e3-c7f4884471a4 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:37.594820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5cc27-8847-4655-a9e3-c7f4884471a4 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:37.606350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:37.608315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:37.608895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:37.609394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] PATH_INFO: `/v3/users/28591ed777f146c9abba96201c3a06a3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:37.611365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28591ed777f146c9abba96201c3a06a3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:37.614045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:37.697964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28591ed777f146c9abba96201c3a06a3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:37.699038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28591ed777f146c9abba96201c3a06a3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:37.720447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28591ed777f146c9abba96201c3a06a3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:37.735153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28591ed777f146c9abba96201c3a06a3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:37.735876 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28591ed777f146c9abba96201c3a06a3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:37.758641 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1263/2485] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:37 2022] DELETE /identity/v3/users/28591ed777f146c9abba96201c3a06a3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:37.763837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2faf8e-8a94-4597-82cb-8f1aa645d9c0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:37.764479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2faf8e-8a94-4597-82cb-8f1aa645d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:37.764760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2faf8e-8a94-4597-82cb-8f1aa645d9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:37.778977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:37.785642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2e2faf8e-8a94-4597-82cb-8f1aa645d9c0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:37.787566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2e2faf8e-8a94-4597-82cb-8f1aa645d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:37.859502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1223/2486] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:37.869602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:37.871693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:37.932253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb8746-1bef-4f38-8ba6-3ec555e33f5f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:37.936509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc2a52-db41-4de1-9775-1160df489e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:37.937183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2a52-db41-4de1-9775-1160df489e6b service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:37.937480 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2a52-db41-4de1-9775-1160df489e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:37.937756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc2a52-db41-4de1-9775-1160df489e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:37.947523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc2a52-db41-4de1-9775-1160df489e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:37.949121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc2a52-db41-4de1-9775-1160df489e6b service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:37.960817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1264/2487] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:38.270920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2faf8e-8a94-4597-82cb-8f1aa645d9c0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:38.273288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2e2faf8e-8a94-4597-82cb-8f1aa645d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:38.291582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2faf8e-8a94-4597-82cb-8f1aa645d9c0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:38.304305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:38.306357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:38.306357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:38.306357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] PATH_INFO: `/v3/projects/ac3af36a390544db86d8a099a19291ef` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:38.307167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3af36a390544db86d8a099a19291ef)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:38.309700 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:38.379384 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3af36a390544db86d8a099a19291ef', 'request_id': 'req-d11d9573-3dd3-43e2-8ab8-f038b90e479a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.385394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3af36a390544db86d8a099a19291ef', 'request_id': 'req-d11d9573-3dd3-43e2-8ab8-f038b90e479a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.393797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3af36a390544db86d8a099a19291ef', 'request_id': 'req-d11d9573-3dd3-43e2-8ab8-f038b90e479a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.407769 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] The token cache is being invalidate because project ac3af36a390544db86d8a099a19291ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:38.408057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.408765 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.410426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1224/2488] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:38 2022] DELETE /identity/v3/projects/ac3af36a390544db86d8a099a19291ef => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:38.414520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc2a52-db41-4de1-9775-1160df489e6b service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:38.425346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc2a52-db41-4de1-9775-1160df489e6b service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:38.437913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:38.498822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:38.499714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:38.500002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:38.500313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] PATH_INFO: `/v3/users/10f3d62baecd4ba48705b4d15c39bc2a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:38.501522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f3d62baecd4ba48705b4d15c39bc2a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:38.503443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:38.559771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f3d62baecd4ba48705b4d15c39bc2a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.560486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f3d62baecd4ba48705b4d15c39bc2a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.567993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f3d62baecd4ba48705b4d15c39bc2a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.578195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f3d62baecd4ba48705b4d15c39bc2a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.578858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f3d62baecd4ba48705b4d15c39bc2a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:38.600334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1265/2489] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:38 2022] DELETE /identity/v3/users/10f3d62baecd4ba48705b4d15c39bc2a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:39.168546 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.170946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:39.184611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d9573-3dd3-43e2-8ab8-f038b90e479a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.189827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.191259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:39.253337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.254132 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.254417 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.254697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] PATH_INFO: `/v3/projects/1aa4e0d6aaac43c08a6a8145cda94a09` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.255893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa4e0d6aaac43c08a6a8145cda94a09)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.257915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.272322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94b8a7-7e28-40f3-a963-db6da65b9e99 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.276896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.278371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.278653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.278925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] PATH_INFO: `/v3/users/4399658c6afd4afdb0bbca33db91b80b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.280154 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4399658c6afd4afdb0bbca33db91b80b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.282088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.299716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:39.314178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa4e0d6aaac43c08a6a8145cda94a09', 'request_id': 'req-f633c10b-85d5-4c8a-ba61-5699512c16a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.319842 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa4e0d6aaac43c08a6a8145cda94a09', 'request_id': 'req-f633c10b-85d5-4c8a-ba61-5699512c16a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.324995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:39.329481 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa4e0d6aaac43c08a6a8145cda94a09', 'request_id': 'req-f633c10b-85d5-4c8a-ba61-5699512c16a2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.336384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4399658c6afd4afdb0bbca33db91b80b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.337569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4399658c6afd4afdb0bbca33db91b80b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.342970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] The token cache is being invalidate because project 1aa4e0d6aaac43c08a6a8145cda94a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:39.343521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.344362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-f633c10b-85d5-4c8a-ba61-5699512c16a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.345918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1225/2490] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:39 2022] DELETE /identity/v3/projects/1aa4e0d6aaac43c08a6a8145cda94a09 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:39.346959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4399658c6afd4afdb0bbca33db91b80b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.350634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93a95-d7e3-442f-a7c6-dbe80722f9d0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.351072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93a95-d7e3-442f-a7c6-dbe80722f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.351357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93a95-d7e3-442f-a7c6-dbe80722f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.355717 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4399658c6afd4afdb0bbca33db91b80b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.356510 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5710a04a-51fc-4efa-83dc-a1ad56b50464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4399658c6afd4afdb0bbca33db91b80b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.371453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d5a93a95-d7e3-442f-a7c6-dbe80722f9d0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:39.372696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d5a93a95-d7e3-442f-a7c6-dbe80722f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:39.376711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1266/2491] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:39 2022] DELETE /identity/v3/users/4399658c6afd4afdb0bbca33db91b80b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:39.439696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1226/2492] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:39.447592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d8c0-d36e-4613-9485-57633a1aab74 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.447883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d8c0-d36e-4613-9485-57633a1aab74 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.448195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d8c0-d36e-4613-9485-57633a1aab74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.576287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93a95-d7e3-442f-a7c6-dbe80722f9d0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.577725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d5a93a95-d7e3-442f-a7c6-dbe80722f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:39.591956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9f05d8c0-d36e-4613-9485-57633a1aab74 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:39.593258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9f05d8c0-d36e-4613-9485-57633a1aab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:39.601306 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93a95-d7e3-442f-a7c6-dbe80722f9d0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.662010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1267/2493] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:39.666149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d8c0-d36e-4613-9485-57633a1aab74 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.669550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.670563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.670703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.670970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] PATH_INFO: `/v3/projects/9d6321d39500480a84ad13d436a6b73a` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.677114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d8c0-d36e-4613-9485-57633a1aab74 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.683198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.684937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.685288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.685778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.686664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:27:39.686930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6321d39500480a84ad13d436a6b73a)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.687422 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.689001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.689329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.702733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1268/2494] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:27:39.707177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.718496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575ed45-8c2a-4790-a8c1-88599232ff31 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.724726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e535a-deb8-447e-92b2-4b337463e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.725947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e535a-deb8-447e-92b2-4b337463e034 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.726298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e535a-deb8-447e-92b2-4b337463e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.726586 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e535a-deb8-447e-92b2-4b337463e034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.727280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e535a-deb8-447e-92b2-4b337463e034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.729463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e535a-deb8-447e-92b2-4b337463e034 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.743854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6321d39500480a84ad13d436a6b73a', 'request_id': 'req-dc5923a7-442b-417f-84d6-adb355f6e768'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.749747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:39.751877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6321d39500480a84ad13d436a6b73a', 'request_id': 'req-dc5923a7-442b-417f-84d6-adb355f6e768'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.761230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6321d39500480a84ad13d436a6b73a', 'request_id': 'req-dc5923a7-442b-417f-84d6-adb355f6e768'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.768969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1269/2495] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/projects => generated 361 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:39.773078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e535a-deb8-447e-92b2-4b337463e034 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.774209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] The token cache is being invalidate because project 9d6321d39500480a84ad13d436a6b73a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:39.774578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.775323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dc5923a7-442b-417f-84d6-adb355f6e768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:39.777085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1227/2496] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:39 2022] DELETE /identity/v3/projects/9d6321d39500480a84ad13d436a6b73a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:39.781690 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d99bb-9f11-4da3-a03d-9c492c130551 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.782119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d99bb-9f11-4da3-a03d-9c492c130551 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.782424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d99bb-9f11-4da3-a03d-9c492c130551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.799784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3a4d99bb-9f11-4da3-a03d-9c492c130551 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:39.801018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3a4d99bb-9f11-4da3-a03d-9c492c130551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:39.834642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e535a-deb8-447e-92b2-4b337463e034 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.839188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f1c4-ce08-4558-a92f-ae1c8754eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.839906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f1c4-ce08-4558-a92f-ae1c8754eb15 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.840217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f1c4-ce08-4558-a92f-ae1c8754eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.840496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f1c4-ce08-4558-a92f-ae1c8754eb15 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.841202 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f1c4-ce08-4558-a92f-ae1c8754eb15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.843106 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f1c4-ce08-4558-a92f-ae1c8754eb15 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.859669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:39.863604 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1228/2497] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:39.865959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1270/2498] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:39.871062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d99bb-9f11-4da3-a03d-9c492c130551 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.872400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64612778-1ae8-4b5b-8774-4335b08956c3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.872868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64612778-1ae8-4b5b-8774-4335b08956c3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.873215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3a4d99bb-9f11-4da3-a03d-9c492c130551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:39.873384 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64612778-1ae8-4b5b-8774-4335b08956c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.885603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d99bb-9f11-4da3-a03d-9c492c130551 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.890311 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf29c5-d21d-4663-ae38-d52cc2276c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.890981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf29c5-d21d-4663-ae38-d52cc2276c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.891263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf29c5-d21d-4663-ae38-d52cc2276c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.891537 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf29c5-d21d-4663-ae38-d52cc2276c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.892301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf29c5-d21d-4663-ae38-d52cc2276c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.892741 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-64612778-1ae8-4b5b-8774-4335b08956c3 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:39.893948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-64612778-1ae8-4b5b-8774-4335b08956c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:39.894364 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf29c5-d21d-4663-ae38-d52cc2276c3d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.902143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1271/2499] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:39.907298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1229/2500] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:39.907462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64612778-1ae8-4b5b-8774-4335b08956c3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.908268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf29c5-d21d-4663-ae38-d52cc2276c3d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.915971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64612778-1ae8-4b5b-8774-4335b08956c3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.918717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf29c5-d21d-4663-ae38-d52cc2276c3d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.921179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.921833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.922119 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.922395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.923121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:27:39.923426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.923637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab886-78bf-4c05-b2a9-0d9fd5326404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.924335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab886-78bf-4c05-b2a9-0d9fd5326404 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.924620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab886-78bf-4c05-b2a9-0d9fd5326404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.924895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab886-78bf-4c05-b2a9-0d9fd5326404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.925050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.925613 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ab886-78bf-4c05-b2a9-0d9fd5326404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.927198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ab886-78bf-4c05-b2a9-0d9fd5326404 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.937461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1272/2501] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:27:39.941594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1230/2502] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:39.942011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.942520 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab886-78bf-4c05-b2a9-0d9fd5326404 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:39.951544 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9faf9-d470-4bfc-bb54-88e38a51c4a1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.952173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab886-78bf-4c05-b2a9-0d9fd5326404 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:39.956185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba064db-7f9a-40aa-8f10-5952eea57602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.956707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ceab0-3b27-482c-bd26-f8b900432bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:39.956843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba064db-7f9a-40aa-8f10-5952eea57602 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.957113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba064db-7f9a-40aa-8f10-5952eea57602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.957388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba064db-7f9a-40aa-8f10-5952eea57602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.957573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ceab0-3b27-482c-bd26-f8b900432bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:39.957854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ceab0-3b27-482c-bd26-f8b900432bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:39.958392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ceab0-3b27-482c-bd26-f8b900432bea admin admin] PATH_INFO: `/v3/projects/0c8e1969d9a84cf3b5c133448f1eac1b/users/ba803f4c49ca475fb0abb995e661b8f9/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:39.958512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba064db-7f9a-40aa-8f10-5952eea57602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.960404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba064db-7f9a-40aa-8f10-5952eea57602 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.973406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ceab0-3b27-482c-bd26-f8b900432bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8e1969d9a84cf3b5c133448f1eac1b, user_id=ba803f4c49ca475fb0abb995e661b8f9, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:39.976083 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ceab0-3b27-482c-bd26-f8b900432bea admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:39.989127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1273/2503] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:39.990312 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1231/2504] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:39 2022] PUT /identity/v3/projects/0c8e1969d9a84cf3b5c133448f1eac1b/users/ba803f4c49ca475fb0abb995e661b8f9/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:39.993145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ceab0-3b27-482c-bd26-f8b900432bea admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.001034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2ea31-6c88-4430-817b-cbfd7c6913fb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.001430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2ea31-6c88-4430-817b-cbfd7c6913fb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.001709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2ea31-6c88-4430-817b-cbfd7c6913fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.039784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d9f2ea31-6c88-4430-817b-cbfd7c6913fb None None] MFA Rules not processed for user `ba803f4c49ca475fb0abb995e661b8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:40.041443 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d9f2ea31-6c88-4430-817b-cbfd7c6913fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:40.070702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ceab0-3b27-482c-bd26-f8b900432bea admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.132024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:40.136140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1274/2505] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:27:40.171038 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb23f5-9f13-41bf-9c64-64d1b0eb7c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.172225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2ea31-6c88-4430-817b-cbfd7c6913fb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.172929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb23f5-9f13-41bf-9c64-64d1b0eb7c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.173414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb23f5-9f13-41bf-9c64-64d1b0eb7c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.173878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb23f5-9f13-41bf-9c64-64d1b0eb7c83 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.174254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d9f2ea31-6c88-4430-817b-cbfd7c6913fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:40.175182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb23f5-9f13-41bf-9c64-64d1b0eb7c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.178516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb23f5-9f13-41bf-9c64-64d1b0eb7c83 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.218981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1232/2506] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:39 2022] POST /identity/v3/users => generated 303 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:40.220151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb23f5-9f13-41bf-9c64-64d1b0eb7c83 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.232071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb23f5-9f13-41bf-9c64-64d1b0eb7c83 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.240997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61f3aa-979a-4cfe-89a6-78ffabd5ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.241797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f3aa-979a-4cfe-89a6-78ffabd5ae3e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.242079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f3aa-979a-4cfe-89a6-78ffabd5ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.242350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f3aa-979a-4cfe-89a6-78ffabd5ae3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.243228 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61f3aa-979a-4cfe-89a6-78ffabd5ae3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.245095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61f3aa-979a-4cfe-89a6-78ffabd5ae3e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.249286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2ea31-6c88-4430-817b-cbfd7c6913fb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.253138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb6f59-82a7-43b0-81a1-696aa2a71bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.253791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb6f59-82a7-43b0-81a1-696aa2a71bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.254070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb6f59-82a7-43b0-81a1-696aa2a71bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.254340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb6f59-82a7-43b0-81a1-696aa2a71bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.256516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1233/2507] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:40.260459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61f3aa-979a-4cfe-89a6-78ffabd5ae3e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.264068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb6f59-82a7-43b0-81a1-696aa2a71bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.265617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb6f59-82a7-43b0-81a1-696aa2a71bd5 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.271504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61f3aa-979a-4cfe-89a6-78ffabd5ae3e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.275745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988a5ab-d0c4-4438-8505-03cf5e1f5c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.276459 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988a5ab-d0c4-4438-8505-03cf5e1f5c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.277204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988a5ab-d0c4-4438-8505-03cf5e1f5c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.277204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988a5ab-d0c4-4438-8505-03cf5e1f5c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.277969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1275/2508] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:27:40.278343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988a5ab-d0c4-4438-8505-03cf5e1f5c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.279966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988a5ab-d0c4-4438-8505-03cf5e1f5c7d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.293999 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb6f59-82a7-43b0-81a1-696aa2a71bd5 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.310612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb6f59-82a7-43b0-81a1-696aa2a71bd5 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.311711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1234/2509] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:27:40.317056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988a5ab-d0c4-4438-8505-03cf5e1f5c7d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.319511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.320576 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.320925 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.321268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] PATH_INFO: `/v3/users/ba803f4c49ca475fb0abb995e661b8f9` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.322667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba803f4c49ca475fb0abb995e661b8f9)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.324982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.330114 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988a5ab-d0c4-4438-8505-03cf5e1f5c7d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.335517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed68199-a9cc-4eba-bdb8-e808e5075515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.337829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed68199-a9cc-4eba-bdb8-e808e5075515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.337829 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed68199-a9cc-4eba-bdb8-e808e5075515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.338068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed68199-a9cc-4eba-bdb8-e808e5075515 admin admin] PATH_INFO: `/v3/projects/d402094613d14b30b770e833fc5fef95/users/75260b5a5e8b4ef7b3e1808b663b3ed2/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.363992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed68199-a9cc-4eba-bdb8-e808e5075515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d402094613d14b30b770e833fc5fef95, user_id=75260b5a5e8b4ef7b3e1808b663b3ed2, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.366779 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed68199-a9cc-4eba-bdb8-e808e5075515 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.380785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1235/2510] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:40 2022] PUT /identity/v3/projects/d402094613d14b30b770e833fc5fef95/users/75260b5a5e8b4ef7b3e1808b663b3ed2/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:40.387658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:40.390623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba803f4c49ca475fb0abb995e661b8f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:40.391671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dabd43-cc41-46b3-b5f2-741ca657d671 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.392041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dabd43-cc41-46b3-b5f2-741ca657d671 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.392559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba803f4c49ca475fb0abb995e661b8f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:40.394097 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dabd43-cc41-46b3-b5f2-741ca657d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.405030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba803f4c49ca475fb0abb995e661b8f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:40.415465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba803f4c49ca475fb0abb995e661b8f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:40.417370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19c3e17d-1166-4321-9d56-04be307b8f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba803f4c49ca475fb0abb995e661b8f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:40.431793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-79dabd43-cc41-46b3-b5f2-741ca657d671 None None] MFA Rules not processed for user `75260b5a5e8b4ef7b3e1808b663b3ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:40.433139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-79dabd43-cc41-46b3-b5f2-741ca657d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:40.444176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1276/2511] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:40 2022] DELETE /identity/v3/users/ba803f4c49ca475fb0abb995e661b8f9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:40.449262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97389771-6f0b-49e2-8786-0db02799fea9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.449514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97389771-6f0b-49e2-8786-0db02799fea9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.449860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97389771-6f0b-49e2-8786-0db02799fea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.473415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-97389771-6f0b-49e2-8786-0db02799fea9 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:40.474930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-97389771-6f0b-49e2-8786-0db02799fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:40.518957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1236/2512] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:27:40.524196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dabd43-cc41-46b3-b5f2-741ca657d671 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.527230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-79dabd43-cc41-46b3-b5f2-741ca657d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:40.566105 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1277/2513] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:40.572573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97389771-6f0b-49e2-8786-0db02799fea9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.574162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-97389771-6f0b-49e2-8786-0db02799fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:40.630716 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dabd43-cc41-46b3-b5f2-741ca657d671 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.635420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074f2d-6b37-4238-85c0-307b1c865beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.636214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074f2d-6b37-4238-85c0-307b1c865beb admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.636553 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074f2d-6b37-4238-85c0-307b1c865beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.637357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074f2d-6b37-4238-85c0-307b1c865beb admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.638095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074f2d-6b37-4238-85c0-307b1c865beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.640082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074f2d-6b37-4238-85c0-307b1c865beb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.644320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97389771-6f0b-49e2-8786-0db02799fea9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.648563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec420-2730-4cdc-9ea1-d9ac9eea1f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.649243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec420-2730-4cdc-9ea1-d9ac9eea1f1b service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.649525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec420-2730-4cdc-9ea1-d9ac9eea1f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.649802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec420-2730-4cdc-9ea1-d9ac9eea1f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.661522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec420-2730-4cdc-9ea1-d9ac9eea1f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.663124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec420-2730-4cdc-9ea1-d9ac9eea1f1b service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.676374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1237/2514] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:40 2022] POST /identity/v3/projects => generated 403 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:40.676609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1278/2515] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:27:40.678040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074f2d-6b37-4238-85c0-307b1c865beb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.682571 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:40.765979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074f2d-6b37-4238-85c0-307b1c865beb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.771072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b214eb1-011a-43af-b5a0-0a0dc6707d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.771762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b214eb1-011a-43af-b5a0-0a0dc6707d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.772044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b214eb1-011a-43af-b5a0-0a0dc6707d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.772373 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b214eb1-011a-43af-b5a0-0a0dc6707d57 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.773082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b214eb1-011a-43af-b5a0-0a0dc6707d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.775285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b214eb1-011a-43af-b5a0-0a0dc6707d57 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.800736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1238/2516] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:40 2022] POST /identity/v3/users => generated 308 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:40.801703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec420-2730-4cdc-9ea1-d9ac9eea1f1b service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.811809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec420-2730-4cdc-9ea1-d9ac9eea1f1b service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.816782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06ed8d-3d5c-446a-a6e3-fe955b361133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.817448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06ed8d-3d5c-446a-a6e3-fe955b361133 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.817727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06ed8d-3d5c-446a-a6e3-fe955b361133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.817998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06ed8d-3d5c-446a-a6e3-fe955b361133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.818723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06ed8d-3d5c-446a-a6e3-fe955b361133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.820339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06ed8d-3d5c-446a-a6e3-fe955b361133 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.838529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1279/2517] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:27:40.843410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b214eb1-011a-43af-b5a0-0a0dc6707d57 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.867330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b214eb1-011a-43af-b5a0-0a0dc6707d57 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.873848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:40.874864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:40.875374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:40.875750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] PATH_INFO: `/v3/projects/2f544ee96b0a484c89f4f0b8ed800d82/users/a3000ceaff584d008d7821a29b1bd9d2/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:40.892791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f544ee96b0a484c89f4f0b8ed800d82, user_id=a3000ceaff584d008d7821a29b1bd9d2, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:40.895587 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:40.915308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1239/2518] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:40 2022] PUT /identity/v3/projects/2f544ee96b0a484c89f4f0b8ed800d82/users/a3000ceaff584d008d7821a29b1bd9d2/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:40.917135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06ed8d-3d5c-446a-a6e3-fe955b361133 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.928459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06ed8d-3d5c-446a-a6e3-fe955b361133 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:40.984947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:40.992250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:40.994882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.001359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064922f-3789-4a68-ae35-80be70d95a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.009594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064922f-3789-4a68-ae35-80be70d95a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.010116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064922f-3789-4a68-ae35-80be70d95a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.010461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064922f-3789-4a68-ae35-80be70d95a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.011307 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064922f-3789-4a68-ae35-80be70d95a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.013826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064922f-3789-4a68-ae35-80be70d95a87 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.015892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90fb06-7354-4008-a8da-7283d15128d9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.021566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.022909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.023194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.023473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] PATH_INFO: `/v3/projects/0c8e1969d9a84cf3b5c133448f1eac1b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.024786 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8e1969d9a84cf3b5c133448f1eac1b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.026836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.030464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1280/2519] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:41.032411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064922f-3789-4a68-ae35-80be70d95a87 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.045018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064922f-3789-4a68-ae35-80be70d95a87 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.051197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc662745-4e3d-408c-a18c-2b52dfd8db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.052539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc662745-4e3d-408c-a18c-2b52dfd8db19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.052944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc662745-4e3d-408c-a18c-2b52dfd8db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.053272 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc662745-4e3d-408c-a18c-2b52dfd8db19 admin admin] PATH_INFO: `/v3/projects/2f544ee96b0a484c89f4f0b8ed800d82/users/a3000ceaff584d008d7821a29b1bd9d2/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.056449 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc662745-4e3d-408c-a18c-2b52dfd8db19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f544ee96b0a484c89f4f0b8ed800d82, user_id=a3000ceaff584d008d7821a29b1bd9d2, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.060040 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc662745-4e3d-408c-a18c-2b52dfd8db19 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.072634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1281/2520] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:41 2022] PUT /identity/v3/projects/2f544ee96b0a484c89f4f0b8ed800d82/users/a3000ceaff584d008d7821a29b1bd9d2/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:41.082628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8e1969d9a84cf3b5c133448f1eac1b', 'request_id': 'req-dcaf4b14-3ff7-4873-9e59-af1a6de12556'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.085052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe76a4-c8d7-4c3a-a1b7-3b9538921a40 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.085344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe76a4-c8d7-4c3a-a1b7-3b9538921a40 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.085621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe76a4-c8d7-4c3a-a1b7-3b9538921a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.089955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8e1969d9a84cf3b5c133448f1eac1b', 'request_id': 'req-dcaf4b14-3ff7-4873-9e59-af1a6de12556'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.097412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8e1969d9a84cf3b5c133448f1eac1b', 'request_id': 'req-dcaf4b14-3ff7-4873-9e59-af1a6de12556'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.108887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] The token cache is being invalidate because project 0c8e1969d9a84cf3b5c133448f1eac1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:41.109567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.110245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-dcaf4b14-3ff7-4873-9e59-af1a6de12556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.111943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6fbe76a4-c8d7-4c3a-a1b7-3b9538921a40 None None] MFA Rules not processed for user `a3000ceaff584d008d7821a29b1bd9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:41.115272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1240/2521] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:40 2022] DELETE /identity/v3/projects/0c8e1969d9a84cf3b5c133448f1eac1b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:41.115399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6fbe76a4-c8d7-4c3a-a1b7-3b9538921a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.117288 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2397-3886-4574-a06d-3bd733b3efce None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.117451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2397-3886-4574-a06d-3bd733b3efce None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.117736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2397-3886-4574-a06d-3bd733b3efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.136408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f4ac2397-3886-4574-a06d-3bd733b3efce None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:41.138116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f4ac2397-3886-4574-a06d-3bd733b3efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.184215 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:41.185889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1282/2522] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:41.197126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe76a4-c8d7-4c3a-a1b7-3b9538921a40 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.198851 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6fbe76a4-c8d7-4c3a-a1b7-3b9538921a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.202027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1241/2523] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:41.210914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494168f9-b38c-409a-a2dc-e255efaeb8a4 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.211208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494168f9-b38c-409a-a2dc-e255efaeb8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.211485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494168f9-b38c-409a-a2dc-e255efaeb8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.230861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-494168f9-b38c-409a-a2dc-e255efaeb8a4 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:41.232085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-494168f9-b38c-409a-a2dc-e255efaeb8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.240262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1242/2524] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:27:41.244648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494168f9-b38c-409a-a2dc-e255efaeb8a4 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.255016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494168f9-b38c-409a-a2dc-e255efaeb8a4 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.259924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.260615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.260902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.261179 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.262499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:27:41.262808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.264458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.268531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe76a4-c8d7-4c3a-a1b7-3b9538921a40 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.272610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f622c-47f6-490f-a883-29bf7325acbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.273699 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f622c-47f6-490f-a883-29bf7325acbc service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.273992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f622c-47f6-490f-a883-29bf7325acbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.274269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f622c-47f6-490f-a883-29bf7325acbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.276363 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1243/2525] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:27:41.281149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.283971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f622c-47f6-490f-a883-29bf7325acbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.285471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f622c-47f6-490f-a883-29bf7325acbc service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.290882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727cfe-6902-4409-b090-627698ab8d96 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.295365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1283/2526] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:41.296260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.296977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.297266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.297544 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.298235 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.300189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.336405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1244/2527] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:41.337454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f622c-47f6-490f-a883-29bf7325acbc service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.350257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f622c-47f6-490f-a883-29bf7325acbc service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.411745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1d7c-8b6c-4143-882a-bd85bcab2b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.412453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1d7c-8b6c-4143-882a-bd85bcab2b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.412739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1d7c-8b6c-4143-882a-bd85bcab2b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.413014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa1d7c-8b6c-4143-882a-bd85bcab2b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.413720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa1d7c-8b6c-4143-882a-bd85bcab2b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.415661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa1d7c-8b6c-4143-882a-bd85bcab2b53 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.425942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:41.433226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.435893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.440995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1284/2528] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:41.444926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1d7c-8b6c-4143-882a-bd85bcab2b53 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.448777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b015c7-ffa8-483a-8b16-424cb95e0a62 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.454057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.454959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.455240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.455515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] PATH_INFO: `/v3/users/75260b5a5e8b4ef7b3e1808b663b3ed2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.456787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75260b5a5e8b4ef7b3e1808b663b3ed2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.459045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.463095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa1d7c-8b6c-4143-882a-bd85bcab2b53 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.467934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd35a9-f012-4e98-9848-80e0c6ff13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.468691 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd35a9-f012-4e98-9848-80e0c6ff13a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.468977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd35a9-f012-4e98-9848-80e0c6ff13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.469254 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd35a9-f012-4e98-9848-80e0c6ff13a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.469990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd35a9-f012-4e98-9848-80e0c6ff13a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.471608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd35a9-f012-4e98-9848-80e0c6ff13a1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.482980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1285/2529] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:27:41.486582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd35a9-f012-4e98-9848-80e0c6ff13a1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.497911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd35a9-f012-4e98-9848-80e0c6ff13a1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.502916 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9158f-2642-41ae-a6fe-ca38eec01da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.503615 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9158f-2642-41ae-a6fe-ca38eec01da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.503897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9158f-2642-41ae-a6fe-ca38eec01da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.504214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9158f-2642-41ae-a6fe-ca38eec01da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.504956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9158f-2642-41ae-a6fe-ca38eec01da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.506564 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9158f-2642-41ae-a6fe-ca38eec01da3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.516581 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75260b5a5e8b4ef7b3e1808b663b3ed2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.517277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75260b5a5e8b4ef7b3e1808b663b3ed2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.521241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1286/2530] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:27:41.525458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9158f-2642-41ae-a6fe-ca38eec01da3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.530695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75260b5a5e8b4ef7b3e1808b663b3ed2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.531890 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75260b5a5e8b4ef7b3e1808b663b3ed2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.536941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9158f-2642-41ae-a6fe-ca38eec01da3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.541386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5601e985-05ad-4f58-9be3-2ae17e947359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75260b5a5e8b4ef7b3e1808b663b3ed2'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:41.542590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c30b1-7d58-4438-8fa4-8cd2e6cadcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.544219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c30b1-7d58-4438-8fa4-8cd2e6cadcdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.544505 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c30b1-7d58-4438-8fa4-8cd2e6cadcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.544785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c30b1-7d58-4438-8fa4-8cd2e6cadcdf admin admin] PATH_INFO: `/v3/projects/1920d929854f4d8e8d4d00fd68742790/users/bbcd7c850497493499f90c1cb79a1cef/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.559657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1245/2531] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:41 2022] DELETE /identity/v3/users/75260b5a5e8b4ef7b3e1808b663b3ed2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:41.562012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c30b1-7d58-4438-8fa4-8cd2e6cadcdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1920d929854f4d8e8d4d00fd68742790, user_id=bbcd7c850497493499f90c1cb79a1cef, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.563998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd119-7ffd-4f16-bd48-0a55edde1cec None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.564367 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd119-7ffd-4f16-bd48-0a55edde1cec None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.564709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd119-7ffd-4f16-bd48-0a55edde1cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.564868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c30b1-7d58-4438-8fa4-8cd2e6cadcdf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.583858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1287/2532] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:41 2022] PUT /identity/v3/projects/1920d929854f4d8e8d4d00fd68742790/users/bbcd7c850497493499f90c1cb79a1cef/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:41.587712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8c5fd119-7ffd-4f16-bd48-0a55edde1cec None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:41.588995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8c5fd119-7ffd-4f16-bd48-0a55edde1cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.594648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086474f-4cba-4cc5-ad0a-f9beb550632a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.595086 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086474f-4cba-4cc5-ad0a-f9beb550632a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.595383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086474f-4cba-4cc5-ad0a-f9beb550632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.626631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3086474f-4cba-4cc5-ad0a-f9beb550632a None None] MFA Rules not processed for user `bbcd7c850497493499f90c1cb79a1cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:41.627862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3086474f-4cba-4cc5-ad0a-f9beb550632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.662724 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1246/2533] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:27:41.663514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fd119-7ffd-4f16-bd48-0a55edde1cec None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.665165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8c5fd119-7ffd-4f16-bd48-0a55edde1cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.693187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:41.705649 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1288/2534] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:41.706196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086474f-4cba-4cc5-ad0a-f9beb550632a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.707218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3086474f-4cba-4cc5-ad0a-f9beb550632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.734182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fd119-7ffd-4f16-bd48-0a55edde1cec None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.738443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.739502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.739788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.740062 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.742005 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.767170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086474f-4cba-4cc5-ad0a-f9beb550632a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.771209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.771862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.772170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.772451 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.783937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.785597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.796589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1289/2535] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:41.797485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.799294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:41.813373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c08678-c9bb-4508-b504-b4aa32e1a783 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.819121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.820093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2166c3-1d1b-414f-980b-362a29944f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.820790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2166c3-1d1b-414f-980b-362a29944f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.820923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.821081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2166c3-1d1b-414f-980b-362a29944f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.821406 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2166c3-1d1b-414f-980b-362a29944f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.822080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2166c3-1d1b-414f-980b-362a29944f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.824320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2166c3-1d1b-414f-980b-362a29944f00 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.836590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1247/2536] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:41.869820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1290/2537] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:41.871162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:41.882506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a16951-248c-4868-a39b-2605d84c5bbc service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:41.954932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1696e-4464-4213-bb69-ab0de1df8aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:41.955535 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1696e-4464-4213-bb69-ab0de1df8aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:41.955817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1696e-4464-4213-bb69-ab0de1df8aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:41.956188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1696e-4464-4213-bb69-ab0de1df8aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:41.957000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1696e-4464-4213-bb69-ab0de1df8aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:41.959272 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1696e-4464-4213-bb69-ab0de1df8aa0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:41.983477 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1248/2538] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:41 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:41.987055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2166c3-1d1b-414f-980b-362a29944f00 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.004077 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2166c3-1d1b-414f-980b-362a29944f00 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.024154 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c6ae-ca2b-48ad-84f6-ed2cf8bfa8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.024845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c6ae-ca2b-48ad-84f6-ed2cf8bfa8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.025127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c6ae-ca2b-48ad-84f6-ed2cf8bfa8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.025403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074c6ae-ca2b-48ad-84f6-ed2cf8bfa8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.026136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074c6ae-ca2b-48ad-84f6-ed2cf8bfa8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.028370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074c6ae-ca2b-48ad-84f6-ed2cf8bfa8c9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.039097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1291/2539] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:42.043296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1696e-4464-4213-bb69-ab0de1df8aa0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.067622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1696e-4464-4213-bb69-ab0de1df8aa0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.073688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a26c40-9389-43b4-80f2-11489c6e7511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.074918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26c40-9389-43b4-80f2-11489c6e7511 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.075195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26c40-9389-43b4-80f2-11489c6e7511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.075461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a26c40-9389-43b4-80f2-11489c6e7511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.076232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a26c40-9389-43b4-80f2-11489c6e7511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.077849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a26c40-9389-43b4-80f2-11489c6e7511 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.089205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1249/2540] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:42.094003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c6ae-ca2b-48ad-84f6-ed2cf8bfa8c9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.104961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074c6ae-ca2b-48ad-84f6-ed2cf8bfa8c9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.110618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.111562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.111842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.112136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] PATH_INFO: `/v3/projects/bfb3c65a4fd840109f66dfe89d781c3d/users/b5acce8fbb78442583c55ac28d353744/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.116203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:42.130227 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb3c65a4fd840109f66dfe89d781c3d, user_id=b5acce8fbb78442583c55ac28d353744, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.133027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.148328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1292/2541] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:42 2022] PUT /identity/v3/projects/bfb3c65a4fd840109f66dfe89d781c3d/users/b5acce8fbb78442583c55ac28d353744/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:42.160296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737763e-75c6-4f8d-bff9-ce4f8d996693 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.160710 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737763e-75c6-4f8d-bff9-ce4f8d996693 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.161001 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737763e-75c6-4f8d-bff9-ce4f8d996693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.189678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1737763e-75c6-4f8d-bff9-ce4f8d996693 None None] MFA Rules not processed for user `b5acce8fbb78442583c55ac28d353744`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:42.191023 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1737763e-75c6-4f8d-bff9-ce4f8d996693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:42.203475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.205531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:42.227469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:42.265698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1250/2542] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:42.270161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737763e-75c6-4f8d-bff9-ce4f8d996693 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.286030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e76f73-f1cd-4946-a496-106127a037bb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.291657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.292873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.293186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.293460 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] PATH_INFO: `/v3/projects/d402094613d14b30b770e833fc5fef95` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.294692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d402094613d14b30b770e833fc5fef95)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.296656 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.338493 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737763e-75c6-4f8d-bff9-ce4f8d996693 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.355060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd402094613d14b30b770e833fc5fef95', 'request_id': 'req-3a762966-a221-4285-8fcc-f36672f45869'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.362089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd402094613d14b30b770e833fc5fef95', 'request_id': 'req-3a762966-a221-4285-8fcc-f36672f45869'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.370211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd402094613d14b30b770e833fc5fef95', 'request_id': 'req-3a762966-a221-4285-8fcc-f36672f45869'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.383676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] The token cache is being invalidate because project d402094613d14b30b770e833fc5fef95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:42.383960 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.384653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.386466 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1293/2543] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:42 2022] DELETE /identity/v3/projects/d402094613d14b30b770e833fc5fef95 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:42.391378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.392830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:42.410395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.411067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.411351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.411625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.412343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.414433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.441069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1251/2544] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:42 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:42.444925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.446490 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:42.461096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a762966-a221-4285-8fcc-f36672f45869 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.479164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:42.511063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d56f1-1a89-4466-a7cf-0d3023193fc7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.516445 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032367cc-ffaa-4fc8-a8be-869b2c939233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.517129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032367cc-ffaa-4fc8-a8be-869b2c939233 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.517516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032367cc-ffaa-4fc8-a8be-869b2c939233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.517689 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032367cc-ffaa-4fc8-a8be-869b2c939233 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.518389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032367cc-ffaa-4fc8-a8be-869b2c939233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.520413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032367cc-ffaa-4fc8-a8be-869b2c939233 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.524596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.525473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.525753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.526028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] PATH_INFO: `/v3/users/a3000ceaff584d008d7821a29b1bd9d2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.527837 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3000ceaff584d008d7821a29b1bd9d2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.529803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.530136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:42.543589 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1252/2545] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:42 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:27:42.548314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032367cc-ffaa-4fc8-a8be-869b2c939233 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.561086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032367cc-ffaa-4fc8-a8be-869b2c939233 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.566709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.567515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.567807 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.568079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.568832 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.570439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.580570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3000ceaff584d008d7821a29b1bd9d2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.581316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1253/2546] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:42.581445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3000ceaff584d008d7821a29b1bd9d2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.585562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.587830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:42.591143 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3000ceaff584d008d7821a29b1bd9d2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.599865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3000ceaff584d008d7821a29b1bd9d2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.600625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f428a6-2979-437c-b7f0-6730c0320e6b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.600821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3000ceaff584d008d7821a29b1bd9d2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:42.605379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f113766-5a54-4cd1-9222-ae02c478690b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.606285 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113766-5a54-4cd1-9222-ae02c478690b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.606676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113766-5a54-4cd1-9222-ae02c478690b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.606865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f113766-5a54-4cd1-9222-ae02c478690b admin admin] PATH_INFO: `/v3/projects/69b8cb0caf1240d681ade86661df8877/users/73c07380b1834a67bd1408e405205150/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.618258 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1294/2547] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:42 2022] DELETE /identity/v3/users/a3000ceaff584d008d7821a29b1bd9d2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:42.623210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f113766-5a54-4cd1-9222-ae02c478690b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b8cb0caf1240d681ade86661df8877, user_id=73c07380b1834a67bd1408e405205150, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.625998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f113766-5a54-4cd1-9222-ae02c478690b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.639813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1254/2548] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:42 2022] PUT /identity/v3/projects/69b8cb0caf1240d681ade86661df8877/users/73c07380b1834a67bd1408e405205150/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:42.643759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.706045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fa5aa-8061-4f64-8c5c-7137bd721e35 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.752428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:42.770692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdaa6e-94b3-464e-bcf2-7fb4c7546b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.771386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdaa6e-94b3-464e-bcf2-7fb4c7546b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.771676 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdaa6e-94b3-464e-bcf2-7fb4c7546b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.771956 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdaa6e-94b3-464e-bcf2-7fb4c7546b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.772746 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdaa6e-94b3-464e-bcf2-7fb4c7546b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.774366 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cdaa6e-94b3-464e-bcf2-7fb4c7546b87 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.785243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1295/2549] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:42.789090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f113766-5a54-4cd1-9222-ae02c478690b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.800163 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f113766-5a54-4cd1-9222-ae02c478690b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.804767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.805681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.805964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.806238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] PATH_INFO: `/v3/projects/69b8cb0caf1240d681ade86661df8877/users/73c07380b1834a67bd1408e405205150/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.808226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b8cb0caf1240d681ade86661df8877, user_id=73c07380b1834a67bd1408e405205150, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.811452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:42.822920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1255/2550] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:42 2022] PUT /identity/v3/projects/69b8cb0caf1240d681ade86661df8877/users/73c07380b1834a67bd1408e405205150/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:42.833140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7ac8-3c79-482f-8510-952b61389acb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.833685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7ac8-3c79-482f-8510-952b61389acb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.833968 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c7ac8-3c79-482f-8510-952b61389acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.861215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2d6c7ac8-3c79-482f-8510-952b61389acb None None] MFA Rules not processed for user `73c07380b1834a67bd1408e405205150`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:42.862438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2d6c7ac8-3c79-482f-8510-952b61389acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:42.905435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.907244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:42.946463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1296/2551] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:42.958897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c7ac8-3c79-482f-8510-952b61389acb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:42.960445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2d6c7ac8-3c79-482f-8510-952b61389acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:42.977484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f737ed-fcc6-45fb-bd9c-c93a30184b23 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:42.982751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:42.983625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:42.983895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:42.984202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] PATH_INFO: `/v3/projects/2f544ee96b0a484c89f4f0b8ed800d82` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:42.985526 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f544ee96b0a484c89f4f0b8ed800d82)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:42.987441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.021273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c7ac8-3c79-482f-8510-952b61389acb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.025398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2be7-14a8-4963-b389-5d829b9ae486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.026120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2be7-14a8-4963-b389-5d829b9ae486 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.026419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2be7-14a8-4963-b389-5d829b9ae486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.026690 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2be7-14a8-4963-b389-5d829b9ae486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.028843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-93ef2be7-14a8-4963-b389-5d829b9ae486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:43.046957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f544ee96b0a484c89f4f0b8ed800d82', 'request_id': 'req-09b1d60b-cf2f-4e96-9254-7fad8202f515'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:43.055533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f544ee96b0a484c89f4f0b8ed800d82', 'request_id': 'req-09b1d60b-cf2f-4e96-9254-7fad8202f515'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:43.066989 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f544ee96b0a484c89f4f0b8ed800d82', 'request_id': 'req-09b1d60b-cf2f-4e96-9254-7fad8202f515'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:43.097194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] The token cache is being invalidate because project 2f544ee96b0a484c89f4f0b8ed800d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:43.097584 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:43.098302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09b1d60b-cf2f-4e96-9254-7fad8202f515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:43.104211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1256/2552] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:42 2022] DELETE /identity/v3/projects/2f544ee96b0a484c89f4f0b8ed800d82 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:43.104408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef2be7-14a8-4963-b389-5d829b9ae486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.104920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef2be7-14a8-4963-b389-5d829b9ae486 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.106665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850151e3-e114-42b1-ae71-6228e81b7379 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.107058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850151e3-e114-42b1-ae71-6228e81b7379 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.107440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850151e3-e114-42b1-ae71-6228e81b7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.116560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1297/2553] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:27:43.129701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-850151e3-e114-42b1-ae71-6228e81b7379 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:43.131211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-850151e3-e114-42b1-ae71-6228e81b7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:43.171583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:43.233505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1257/2554] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:43.241315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598bb6a-dd2c-4888-9aac-a15e1d974bb7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.241910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598bb6a-dd2c-4888-9aac-a15e1d974bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.242141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598bb6a-dd2c-4888-9aac-a15e1d974bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.260617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f598bb6a-dd2c-4888-9aac-a15e1d974bb7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:43.261858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f598bb6a-dd2c-4888-9aac-a15e1d974bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:43.273048 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1298/2555] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:43.275092 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850151e3-e114-42b1-ae71-6228e81b7379 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:43.285534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850151e3-e114-42b1-ae71-6228e81b7379 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.291512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.292427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.292680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.293788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.294586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:27:43.294969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.296792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.313308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1258/2556] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:27:43.314634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598bb6a-dd2c-4888-9aac-a15e1d974bb7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:43.324555 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598bb6a-dd2c-4888-9aac-a15e1d974bb7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.329715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d1696-abf5-4ebc-b4c7-2340db1e0c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.330385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1696-abf5-4ebc-b4c7-2340db1e0c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.330672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1696-abf5-4ebc-b4c7-2340db1e0c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.330951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1696-abf5-4ebc-b4c7-2340db1e0c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.331656 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d1696-abf5-4ebc-b4c7-2340db1e0c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.333880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d1696-abf5-4ebc-b4c7-2340db1e0c40 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.351997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:43.370661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1299/2557] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:43 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:43.372818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:43.386621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522231-d1bf-43a5-9fc0-a153ca32eec9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.471158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfae53f-b119-4cf2-9ad0-c4a53997818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.471888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfae53f-b119-4cf2-9ad0-c4a53997818a admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.472332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfae53f-b119-4cf2-9ad0-c4a53997818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.472694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfae53f-b119-4cf2-9ad0-c4a53997818a admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.473582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfae53f-b119-4cf2-9ad0-c4a53997818a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.475771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfae53f-b119-4cf2-9ad0-c4a53997818a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.498767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1259/2558] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:43 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:43.502669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d1696-abf5-4ebc-b4c7-2340db1e0c40 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:43.514162 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d1696-abf5-4ebc-b4c7-2340db1e0c40 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.524411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7942f-fce2-4241-9d0f-3dddf4f447e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.525367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7942f-fce2-4241-9d0f-3dddf4f447e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.525819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7942f-fce2-4241-9d0f-3dddf4f447e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.526099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7942f-fce2-4241-9d0f-3dddf4f447e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.526864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7942f-fce2-4241-9d0f-3dddf4f447e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.531845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7942f-fce2-4241-9d0f-3dddf4f447e3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.554028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1300/2559] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:43.558500 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfae53f-b119-4cf2-9ad0-c4a53997818a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:43.571927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfae53f-b119-4cf2-9ad0-c4a53997818a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.577266 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6817b-101e-4444-8e5c-2092fd6881ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.577948 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6817b-101e-4444-8e5c-2092fd6881ff admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.578247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6817b-101e-4444-8e5c-2092fd6881ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.578503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6817b-101e-4444-8e5c-2092fd6881ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.579233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6817b-101e-4444-8e5c-2092fd6881ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.580905 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6817b-101e-4444-8e5c-2092fd6881ff admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.592419 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1260/2560] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:43.596833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7942f-fce2-4241-9d0f-3dddf4f447e3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:43.607141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7942f-fce2-4241-9d0f-3dddf4f447e3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.612383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f2ff6-41c8-4203-931e-14a39870543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.616606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2ff6-41c8-4203-931e-14a39870543d admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.616900 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2ff6-41c8-4203-931e-14a39870543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.617199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f2ff6-41c8-4203-931e-14a39870543d admin admin] PATH_INFO: `/v3/projects/b5869cd017694d67a766cbac1f4e6d01/users/806727c5ef0c4311931fa4d4cb7dd3de/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.633849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f2ff6-41c8-4203-931e-14a39870543d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5869cd017694d67a766cbac1f4e6d01, user_id=806727c5ef0c4311931fa4d4cb7dd3de, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.636582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f2ff6-41c8-4203-931e-14a39870543d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.655800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1301/2561] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:43 2022] PUT /identity/v3/projects/b5869cd017694d67a766cbac1f4e6d01/users/806727c5ef0c4311931fa4d4cb7dd3de/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:43.670487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a881-67aa-4a92-a280-b385b753a67b None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.670999 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a881-67aa-4a92-a280-b385b753a67b None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.671507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46a881-67aa-4a92-a280-b385b753a67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.707027 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2e46a881-67aa-4a92-a280-b385b753a67b None None] MFA Rules not processed for user `806727c5ef0c4311931fa4d4cb7dd3de`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:43.711391 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2e46a881-67aa-4a92-a280-b385b753a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:43.790248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1261/2562] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:43.794991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f2ff6-41c8-4203-931e-14a39870543d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:43.871447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f2ff6-41c8-4203-931e-14a39870543d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.876486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c46d50-deef-44c3-b77a-66544a80a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.877170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46d50-deef-44c3-b77a-66544a80a1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.877459 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46d50-deef-44c3-b77a-66544a80a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.877737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c46d50-deef-44c3-b77a-66544a80a1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.878446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c46d50-deef-44c3-b77a-66544a80a1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.880531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c46d50-deef-44c3-b77a-66544a80a1a5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:43.910765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1302/2563] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:43 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:43.913208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46a881-67aa-4a92-a280-b385b753a67b None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:43.924618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46a881-67aa-4a92-a280-b385b753a67b None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:43.957563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:43.991744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c53df-6d17-4a98-9d1c-4984fb8d83eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:43.992514 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c53df-6d17-4a98-9d1c-4984fb8d83eb admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:43.992904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c53df-6d17-4a98-9d1c-4984fb8d83eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:43.993224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c53df-6d17-4a98-9d1c-4984fb8d83eb admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:43.994067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c53df-6d17-4a98-9d1c-4984fb8d83eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:43.997238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c53df-6d17-4a98-9d1c-4984fb8d83eb admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:44.019911 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1262/2564] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:43 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:44.024418 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c46d50-deef-44c3-b77a-66544a80a1a5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:44.034647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c46d50-deef-44c3-b77a-66544a80a1a5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:44.039168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ceeb7-3454-4af6-9ecb-b2616574f4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:44.039823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ceeb7-3454-4af6-9ecb-b2616574f4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:44.040126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ceeb7-3454-4af6-9ecb-b2616574f4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:44.040409 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ceeb7-3454-4af6-9ecb-b2616574f4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:44.041129 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ceeb7-3454-4af6-9ecb-b2616574f4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:44.042710 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ceeb7-3454-4af6-9ecb-b2616574f4a3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:44.059432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1303/2565] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:44.065361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c53df-6d17-4a98-9d1c-4984fb8d83eb admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:44.076656 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c53df-6d17-4a98-9d1c-4984fb8d83eb admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:44.081927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf551aa-9518-4a1c-957b-890683030b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:44.082814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf551aa-9518-4a1c-957b-890683030b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:44.083094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf551aa-9518-4a1c-957b-890683030b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:44.083631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf551aa-9518-4a1c-957b-890683030b85 admin admin] PATH_INFO: `/v3/projects/ecbc379822214bf3b1e688e40c7c1369/users/4cb6f8ee2d5446d3b983c476553dbe07/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:44.099065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf551aa-9518-4a1c-957b-890683030b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbc379822214bf3b1e688e40c7c1369, user_id=4cb6f8ee2d5446d3b983c476553dbe07, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:44.101823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf551aa-9518-4a1c-957b-890683030b85 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:44.114753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1263/2566] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:44 2022] PUT /identity/v3/projects/ecbc379822214bf3b1e688e40c7c1369/users/4cb6f8ee2d5446d3b983c476553dbe07/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:44.118825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ceeb7-3454-4af6-9ecb-b2616574f4a3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:44.129712 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ceeb7-3454-4af6-9ecb-b2616574f4a3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:44.184891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009ae5f-1a9b-413a-8e7e-493945cb2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:44.185567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009ae5f-1a9b-413a-8e7e-493945cb2098 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:44.185852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009ae5f-1a9b-413a-8e7e-493945cb2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:44.186128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009ae5f-1a9b-413a-8e7e-493945cb2098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:44.186923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009ae5f-1a9b-413a-8e7e-493945cb2098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:44.189859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009ae5f-1a9b-413a-8e7e-493945cb2098 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:44.202314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1304/2567] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:44.206725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf551aa-9518-4a1c-957b-890683030b85 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:44.217852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf551aa-9518-4a1c-957b-890683030b85 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:44.222611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:44.223515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:44.223798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:44.224081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] PATH_INFO: `/v3/projects/ecbc379822214bf3b1e688e40c7c1369/users/4cb6f8ee2d5446d3b983c476553dbe07/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:44.226140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbc379822214bf3b1e688e40c7c1369, user_id=4cb6f8ee2d5446d3b983c476553dbe07, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:44.228831 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:44.239997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1264/2568] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:44 2022] PUT /identity/v3/projects/ecbc379822214bf3b1e688e40c7c1369/users/4cb6f8ee2d5446d3b983c476553dbe07/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:44.252098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf00a79-3130-48d3-bac8-8e797b174991 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:44.252415 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf00a79-3130-48d3-bac8-8e797b174991 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:44.252696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf00a79-3130-48d3-bac8-8e797b174991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:44.280319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6cf00a79-3130-48d3-bac8-8e797b174991 None None] MFA Rules not processed for user `4cb6f8ee2d5446d3b983c476553dbe07`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:44.281575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6cf00a79-3130-48d3-bac8-8e797b174991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:44.300478 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:44.353640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1305/2569] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:44.366222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:44.367866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:44.424452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681e9a-eb74-4d5f-b368-568f589df994 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:44.428047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73b0a-7a21-493b-b58d-c11c84a8f873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:44.428732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73b0a-7a21-493b-b58d-c11c84a8f873 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:44.429017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73b0a-7a21-493b-b58d-c11c84a8f873 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:44.429293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73b0a-7a21-493b-b58d-c11c84a8f873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:44.439119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e73b0a-7a21-493b-b58d-c11c84a8f873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:44.440586 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e73b0a-7a21-493b-b58d-c11c84a8f873 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:44.450022 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1265/2570] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:27:44.524019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf00a79-3130-48d3-bac8-8e797b174991 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:44.532248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6cf00a79-3130-48d3-bac8-8e797b174991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:44.545725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf00a79-3130-48d3-bac8-8e797b174991 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:44.549602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d474-ef99-40ff-b445-cd0e96332fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:44.550252 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d474-ef99-40ff-b445-cd0e96332fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:44.550536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d474-ef99-40ff-b445-cd0e96332fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:44.550811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d474-ef99-40ff-b445-cd0e96332fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:44.611284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5d474-ef99-40ff-b445-cd0e96332fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:44.612776 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5d474-ef99-40ff-b445-cd0e96332fb5 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:44.622454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1306/2571] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:44.695723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73b0a-7a21-493b-b58d-c11c84a8f873 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:44.704768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73b0a-7a21-493b-b58d-c11c84a8f873 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:44.708743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:44.709385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:44.709666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:44.709939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:44.712218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:44.784336 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:44.785747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:44.796529 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1266/2572] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:27:45.326985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d474-ef99-40ff-b445-cd0e96332fb5 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:45.335834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d474-ef99-40ff-b445-cd0e96332fb5 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:45.341895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249a973-1ded-4706-8449-c2a6f668a20a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:45.342546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a973-1ded-4706-8449-c2a6f668a20a service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:45.342924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a973-1ded-4706-8449-c2a6f668a20a service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:45.343218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249a973-1ded-4706-8449-c2a6f668a20a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:45.346778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9249a973-1ded-4706-8449-c2a6f668a20a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:45.428177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a973-1ded-4706-8449-c2a6f668a20a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:45.430750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9249a973-1ded-4706-8449-c2a6f668a20a service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:45.448541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1307/2573] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:49.351370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:49.352906 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:49.381854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:49.422334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab92230-006f-4e26-a749-73b7c9a5b278 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:49.433441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:49.433441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:49.433441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:49.434386 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] PATH_INFO: `/v3/users/bbcd7c850497493499f90c1cb79a1cef` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:49.435376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbcd7c850497493499f90c1cb79a1cef)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:49.437404 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:49.488096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbcd7c850497493499f90c1cb79a1cef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:49.488789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbcd7c850497493499f90c1cb79a1cef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:49.501958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbcd7c850497493499f90c1cb79a1cef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:49.502695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbcd7c850497493499f90c1cb79a1cef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:49.510154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbcd7c850497493499f90c1cb79a1cef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:49.524193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1267/2574] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:49 2022] DELETE /identity/v3/users/bbcd7c850497493499f90c1cb79a1cef => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:49.528775 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440539-61be-4d7d-896a-0b1f342470d7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:49.529289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440539-61be-4d7d-896a-0b1f342470d7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:49.529492 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440539-61be-4d7d-896a-0b1f342470d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:49.549983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-88440539-61be-4d7d-896a-0b1f342470d7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:49.551188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-88440539-61be-4d7d-896a-0b1f342470d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:49.595536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:49.611439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1308/2575] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:49.622892 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:49.624676 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:49.686035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab09271-877d-436b-b317-a134b70d4317 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:49.689962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7828-e5ee-4f14-a4d2-634500615f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:49.690631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7828-e5ee-4f14-a4d2-634500615f07 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:49.690918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7828-e5ee-4f14-a4d2-634500615f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:49.691190 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef7828-e5ee-4f14-a4d2-634500615f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:49.701170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7828-e5ee-4f14-a4d2-634500615f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:49.702961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef7828-e5ee-4f14-a4d2-634500615f07 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:49.714582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1268/2576] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:49.988998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88440539-61be-4d7d-896a-0b1f342470d7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:49.990533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-88440539-61be-4d7d-896a-0b1f342470d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:50.005296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88440539-61be-4d7d-896a-0b1f342470d7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:50.010465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:50.011333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:50.011628 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:50.011882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] PATH_INFO: `/v3/projects/1920d929854f4d8e8d4d00fd68742790` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:50.013274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1920d929854f4d8e8d4d00fd68742790)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:50.015263 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:50.062214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1920d929854f4d8e8d4d00fd68742790', 'request_id': 'req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.068985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1920d929854f4d8e8d4d00fd68742790', 'request_id': 'req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.076385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1920d929854f4d8e8d4d00fd68742790', 'request_id': 'req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.087014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] The token cache is being invalidate because project 1920d929854f4d8e8d4d00fd68742790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:50.087295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.087931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.089511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1309/2577] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:49 2022] DELETE /identity/v3/projects/1920d929854f4d8e8d4d00fd68742790 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:50.094101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7828-e5ee-4f14-a4d2-634500615f07 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:50.104146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef7828-e5ee-4f14-a4d2-634500615f07 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:50.146961 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:50.163048 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:50.163924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:50.164284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:50.164524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] PATH_INFO: `/v3/users/b5acce8fbb78442583c55ac28d353744` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:50.165817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5acce8fbb78442583c55ac28d353744)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:50.167695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:50.219996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5acce8fbb78442583c55ac28d353744'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.220681 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5acce8fbb78442583c55ac28d353744'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.233108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5acce8fbb78442583c55ac28d353744'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.233794 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5acce8fbb78442583c55ac28d353744'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.242757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5acce8fbb78442583c55ac28d353744'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.257142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1269/2578] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:50 2022] DELETE /identity/v3/users/b5acce8fbb78442583c55ac28d353744 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:50.556194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:50.557728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:50.575032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac85fd-9ed8-4337-9fe7-d47d55f0c5f0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:50.635084 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:50.635989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:50.636302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:50.636608 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] PATH_INFO: `/v3/projects/bfb3c65a4fd840109f66dfe89d781c3d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:50.638423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb3c65a4fd840109f66dfe89d781c3d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:50.640391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:50.690172 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb3c65a4fd840109f66dfe89d781c3d', 'request_id': 'req-d9fab1fa-3582-497e-aac0-fac9a094f2b2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.697310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb3c65a4fd840109f66dfe89d781c3d', 'request_id': 'req-d9fab1fa-3582-497e-aac0-fac9a094f2b2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.707259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb3c65a4fd840109f66dfe89d781c3d', 'request_id': 'req-d9fab1fa-3582-497e-aac0-fac9a094f2b2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.718404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] The token cache is being invalidate because project bfb3c65a4fd840109f66dfe89d781c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:50.718696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.719321 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.720899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1310/2579] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:50 2022] DELETE /identity/v3/projects/bfb3c65a4fd840109f66dfe89d781c3d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:50.725076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:50.727283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:50.742726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e551c-2b41-4d24-9b72-c86bdf6c508d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:50.798900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:50.799939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:50.800257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:50.800534 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] PATH_INFO: `/v3/users/73c07380b1834a67bd1408e405205150` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:50.801744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c07380b1834a67bd1408e405205150)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:50.803674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:50.848993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c07380b1834a67bd1408e405205150'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.849649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c07380b1834a67bd1408e405205150'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.862182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c07380b1834a67bd1408e405205150'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.862826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c07380b1834a67bd1408e405205150'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.865356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:50.871079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-744c144f-3607-4ae7-b662-291e38efa27d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c07380b1834a67bd1408e405205150'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:50.884634 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1270/2580] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:27:50 2022] DELETE /identity/v3/users/73c07380b1834a67bd1408e405205150 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:27:51.167445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:51.168918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:51.176830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:51.183945 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fab1fa-3582-497e-aac0-fac9a094f2b2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:51.245440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:51.246816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.247096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.247371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] PATH_INFO: `/v3/projects/69b8cb0caf1240d681ade86661df8877` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.248580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b8cb0caf1240d681ade86661df8877)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:51.250476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:51.294829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b8cb0caf1240d681ade86661df8877', 'request_id': 'req-6cda979c-ae55-490f-9a2c-e3178f62a9cb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:51.301276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b8cb0caf1240d681ade86661df8877', 'request_id': 'req-6cda979c-ae55-490f-9a2c-e3178f62a9cb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:51.309250 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b8cb0caf1240d681ade86661df8877', 'request_id': 'req-6cda979c-ae55-490f-9a2c-e3178f62a9cb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:51.319380 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] The token cache is being invalidate because project 69b8cb0caf1240d681ade86661df8877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:27:51.319669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:51.320313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6cda979c-ae55-490f-9a2c-e3178f62a9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:27:51.321849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1311/2581] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:27:51 2022] DELETE /identity/v3/projects/69b8cb0caf1240d681ade86661df8877 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:51.326741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310a188-6b44-4f03-bc42-ac6babc05cba None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.327035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310a188-6b44-4f03-bc42-ac6babc05cba None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.327316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310a188-6b44-4f03-bc42-ac6babc05cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.345727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0310a188-6b44-4f03-bc42-ac6babc05cba None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:51.346957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0310a188-6b44-4f03-bc42-ac6babc05cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:51.405894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1271/2582] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:27:51.413704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9c95-2246-49b0-aa90-25bde8834993 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.413993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9c95-2246-49b0-aa90-25bde8834993 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.414273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9c95-2246-49b0-aa90-25bde8834993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.434253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b29e9c95-2246-49b0-aa90-25bde8834993 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:51.435472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b29e9c95-2246-49b0-aa90-25bde8834993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:51.444568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1312/2583] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:51.448955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310a188-6b44-4f03-bc42-ac6babc05cba None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:51.459072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310a188-6b44-4f03-bc42-ac6babc05cba None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:51.463515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:51.464270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.464552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.465366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.466094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:27:51.466395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:51.468024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:51.479569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1272/2584] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:27:51.484562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e9c95-2246-49b0-aa90-25bde8834993 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:51.493593 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e9c95-2246-49b0-aa90-25bde8834993 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:51.498305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef8b2-7c92-440c-ba7a-a7c8a5f80d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:51.498880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef8b2-7c92-440c-ba7a-a7c8a5f80d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.499182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef8b2-7c92-440c-ba7a-a7c8a5f80d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.499452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef8b2-7c92-440c-ba7a-a7c8a5f80d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.500200 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcef8b2-7c92-440c-ba7a-a7c8a5f80d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:51.502083 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcef8b2-7c92-440c-ba7a-a7c8a5f80d9b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:51.526807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1313/2585] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:27:51 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:51.531402 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:51.541877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0df98-01bd-4813-80c5-2431d267a8b4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:51.606943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a27b8-083f-43fc-b878-13f0f12e6b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:51.607625 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a27b8-083f-43fc-b878-13f0f12e6b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.607913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a27b8-083f-43fc-b878-13f0f12e6b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.608227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a27b8-083f-43fc-b878-13f0f12e6b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.608916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a27b8-083f-43fc-b878-13f0f12e6b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:51.610851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a27b8-083f-43fc-b878-13f0f12e6b98 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:51.633002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1273/2586] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:27:51 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:27:51.637965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef8b2-7c92-440c-ba7a-a7c8a5f80d9b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:51.648214 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef8b2-7c92-440c-ba7a-a7c8a5f80d9b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:51.652991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f6edc-96bb-4abb-a3b4-727ab16528f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:51.653625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f6edc-96bb-4abb-a3b4-727ab16528f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.653963 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f6edc-96bb-4abb-a3b4-727ab16528f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.654181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f6edc-96bb-4abb-a3b4-727ab16528f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.654910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f6edc-96bb-4abb-a3b4-727ab16528f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:51.656546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f6edc-96bb-4abb-a3b4-727ab16528f5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:51.668206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1314/2587] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:51.671974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a27b8-083f-43fc-b878-13f0f12e6b98 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:51.682969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a27b8-083f-43fc-b878-13f0f12e6b98 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:51.688612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532cddc-e315-48a8-a147-0bdaa292758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:51.689357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532cddc-e315-48a8-a147-0bdaa292758a admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.689668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532cddc-e315-48a8-a147-0bdaa292758a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.689945 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532cddc-e315-48a8-a147-0bdaa292758a admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.690774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532cddc-e315-48a8-a147-0bdaa292758a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:51.692511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532cddc-e315-48a8-a147-0bdaa292758a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:51.704826 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1274/2588] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:27:51.709276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f6edc-96bb-4abb-a3b4-727ab16528f5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:51.719225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f6edc-96bb-4abb-a3b4-727ab16528f5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:51.723947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:51.724856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.725138 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.725413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] PATH_INFO: `/v3/projects/86a0597dfef54b39a27a6772c5a24525/users/f6147e389f56479fb9021b03d7af664c/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.740939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a0597dfef54b39a27a6772c5a24525, user_id=f6147e389f56479fb9021b03d7af664c, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:51.744654 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:51.759419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1315/2589] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:27:51 2022] PUT /identity/v3/projects/86a0597dfef54b39a27a6772c5a24525/users/f6147e389f56479fb9021b03d7af664c/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:27:51.765900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e328-9e3f-429e-bf4d-bb1f50598fd7 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.766354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e328-9e3f-429e-bf4d-bb1f50598fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.766449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173e328-9e3f-429e-bf4d-bb1f50598fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.786436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-8173e328-9e3f-429e-bf4d-bb1f50598fd7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:51.787645 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8173e328-9e3f-429e-bf4d-bb1f50598fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:51.837962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:51.853043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1275/2590] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:51.863244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:51.864977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:51.895771 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:27:51.922972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d3ecf-cfb2-4834-a9a6-d5b881f9030e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:51.926600 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:51.927341 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:51.927625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:51.927897 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:51.937286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:51.938704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:51.947808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1316/2591] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:27:52.558431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de93c9-05cb-43b3-8009-088675c49d73 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:52.559297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de93c9-05cb-43b3-8009-088675c49d73 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:52.559600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de93c9-05cb-43b3-8009-088675c49d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:52.585748 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-97de93c9-05cb-43b3-8009-088675c49d73 None None] MFA Rules not processed for user `f6147e389f56479fb9021b03d7af664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:52.586997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-97de93c9-05cb-43b3-8009-088675c49d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:52.658600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1276/2592] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:52.670281 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:52.671838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:52.732290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236bb1c-4cb4-4d43-aa82-3ff6fa858cc5 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:52.735958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:52.736651 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:52.736934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:52.737207 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:52.747098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:52.748657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:52.758823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1317/2593] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:27:54.125231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed03f-3628-41be-94e9-4d9bdec08cdd None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:54.125757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed03f-3628-41be-94e9-4d9bdec08cdd None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:54.125878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed03f-3628-41be-94e9-4d9bdec08cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:54.144707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f2bed03f-3628-41be-94e9-4d9bdec08cdd None None] MFA Rules not processed for user `f6147e389f56479fb9021b03d7af664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:27:54.145784 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f2bed03f-3628-41be-94e9-4d9bdec08cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:54.154418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1277/2594] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:27:54.737838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:27:54.739387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:54.751977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33acf2-3813-4ea2-af8e-d6d5dae7ae81 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:27:54.755527 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:27:54.757149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:27:54.757149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:27:54.757149 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:27:54.762787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:27:54.835982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:27:54.837464 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:27:54.848924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1318/2595] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:27:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:04.138482 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=39 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:04.843733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=73 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:09.549120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7299de-5465-458c-b2c4-5294f20c8569 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:09.549606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7299de-5465-458c-b2c4-5294f20c8569 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:09.549720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7299de-5465-458c-b2c4-5294f20c8569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:09.566630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-0f7299de-5465-458c-b2c4-5294f20c8569 None None] MFA Rules not processed for user `f6147e389f56479fb9021b03d7af664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:09.567883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0f7299de-5465-458c-b2c4-5294f20c8569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:09.574612 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1278/2596] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:09.816125 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:09.825402 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9885868-74d9-497e-a3e6-67861de7ea22 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:09.830142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:09.830971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:09.831253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:09.831525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:09.834121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:09.844739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:09.846156 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:09.856059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1319/2597] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:10.189244 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7299de-5465-458c-b2c4-5294f20c8569 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:10.191426 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-0f7299de-5465-458c-b2c4-5294f20c8569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:10.285333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7299de-5465-458c-b2c4-5294f20c8569 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:10.291251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:10.292494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:10.292998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:10.293461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:10.296456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:10.309198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:10.310780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:10.321466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1279/2598] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:12.642436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:12.651430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71a966-0486-4081-81ce-d10f33dc7a81 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:12.655750 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b786b-a11c-476c-bb64-65e41d8c3c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:12.656483 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b786b-a11c-476c-bb64-65e41d8c3c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:12.656765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b786b-a11c-476c-bb64-65e41d8c3c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:12.657039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b786b-a11c-476c-bb64-65e41d8c3c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:12.658839 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-652b786b-a11c-476c-bb64-65e41d8c3c47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:12.669939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b786b-a11c-476c-bb64-65e41d8c3c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:12.671417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b786b-a11c-476c-bb64-65e41d8c3c47 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:12.679792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1320/2599] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:14.011600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:14.013068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:14.025933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948a6f-42a3-4d25-b4bc-3c103a8cf589 service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:14.031275 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:14.032194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:14.032483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:14.032764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] PATH_INFO: `/v3/users/806727c5ef0c4311931fa4d4cb7dd3de` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:14.033960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806727c5ef0c4311931fa4d4cb7dd3de)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:14.035870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:14.087666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806727c5ef0c4311931fa4d4cb7dd3de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.088370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806727c5ef0c4311931fa4d4cb7dd3de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.100462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806727c5ef0c4311931fa4d4cb7dd3de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.101085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806727c5ef0c4311931fa4d4cb7dd3de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.108675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806727c5ef0c4311931fa4d4cb7dd3de'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.120834 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1280/2600] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:28:14 2022] DELETE /identity/v3/users/806727c5ef0c4311931fa4d4cb7dd3de => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:14.125395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4e08-e2f1-448a-9d5b-cf9fa1154b8f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:14.125901 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4e08-e2f1-448a-9d5b-cf9fa1154b8f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:14.126032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4e08-e2f1-448a-9d5b-cf9fa1154b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:14.144056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d7fe4e08-e2f1-448a-9d5b-cf9fa1154b8f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:14.145285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d7fe4e08-e2f1-448a-9d5b-cf9fa1154b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:14.202206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1321/2601] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:14.212161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:14.213563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:14.271637 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa36f20-89a5-4906-93eb-325a102590b4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:14.275238 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee683b0-9890-40e8-9793-2ea9b9103ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:14.275887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee683b0-9890-40e8-9793-2ea9b9103ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:14.276226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee683b0-9890-40e8-9793-2ea9b9103ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:14.276504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee683b0-9890-40e8-9793-2ea9b9103ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:14.285351 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee683b0-9890-40e8-9793-2ea9b9103ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:14.286780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee683b0-9890-40e8-9793-2ea9b9103ce2 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:14.290657 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:14.298852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1281/2602] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:14.567884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe4e08-e2f1-448a-9d5b-cf9fa1154b8f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:14.569329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d7fe4e08-e2f1-448a-9d5b-cf9fa1154b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:14.581327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe4e08-e2f1-448a-9d5b-cf9fa1154b8f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:14.586497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:14.587373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:14.587643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:14.587920 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] PATH_INFO: `/v3/projects/b5869cd017694d67a766cbac1f4e6d01` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:14.589133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5869cd017694d67a766cbac1f4e6d01)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:14.591182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:14.637769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5869cd017694d67a766cbac1f4e6d01', 'request_id': 'req-2efad929-7623-455e-aa0d-e7c2df3054c9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.643969 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5869cd017694d67a766cbac1f4e6d01', 'request_id': 'req-2efad929-7623-455e-aa0d-e7c2df3054c9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.652373 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5869cd017694d67a766cbac1f4e6d01', 'request_id': 'req-2efad929-7623-455e-aa0d-e7c2df3054c9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.663304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] The token cache is being invalidate because project b5869cd017694d67a766cbac1f4e6d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:28:14.663588 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.664243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.665770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1322/2603] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:28:14 2022] DELETE /identity/v3/projects/b5869cd017694d67a766cbac1f4e6d01 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:14.670349 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee683b0-9890-40e8-9793-2ea9b9103ce2 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:14.680050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee683b0-9890-40e8-9793-2ea9b9103ce2 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:14.735949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:14.736781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:14.737061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:14.737333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] PATH_INFO: `/v3/users/4cb6f8ee2d5446d3b983c476553dbe07` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:14.738521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb6f8ee2d5446d3b983c476553dbe07)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:14.740469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:14.786799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb6f8ee2d5446d3b983c476553dbe07'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.787449 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb6f8ee2d5446d3b983c476553dbe07'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.799966 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb6f8ee2d5446d3b983c476553dbe07'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.800664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb6f8ee2d5446d3b983c476553dbe07'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.811089 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-61d2cd34-4ce3-41bb-8f8a-8fa6c7828c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb6f8ee2d5446d3b983c476553dbe07'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:14.823820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1282/2604] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:28:14 2022] DELETE /identity/v3/users/4cb6f8ee2d5446d3b983c476553dbe07 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:15.107880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.109353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:15.123859 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad929-7623-455e-aa0d-e7c2df3054c9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.175759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:15.182573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:15.183486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.184206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.184761 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] PATH_INFO: `/v3/projects/ecbc379822214bf3b1e688e40c7c1369` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.187033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbc379822214bf3b1e688e40c7c1369)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:15.189398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:15.240512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbc379822214bf3b1e688e40c7c1369', 'request_id': 'req-c3a8e218-6483-4b3f-b97a-8926be0164ec'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:15.249090 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbc379822214bf3b1e688e40c7c1369', 'request_id': 'req-c3a8e218-6483-4b3f-b97a-8926be0164ec'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:15.258191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbc379822214bf3b1e688e40c7c1369', 'request_id': 'req-c3a8e218-6483-4b3f-b97a-8926be0164ec'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:15.270631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] The token cache is being invalidate because project ecbc379822214bf3b1e688e40c7c1369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:28:15.270976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:15.271872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c3a8e218-6483-4b3f-b97a-8926be0164ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:15.273514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1323/2605] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:28:15 2022] DELETE /identity/v3/projects/ecbc379822214bf3b1e688e40c7c1369 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:15.278924 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac8610-dfd4-4323-b64a-1bc6f215351d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.279407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac8610-dfd4-4323-b64a-1bc6f215351d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.279504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac8610-dfd4-4323-b64a-1bc6f215351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.297333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-9bac8610-dfd4-4323-b64a-1bc6f215351d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:15.298552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-9bac8610-dfd4-4323-b64a-1bc6f215351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:15.359488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1283/2606] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:15.367504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894038d1-586a-49b2-b603-b0fbb9886d88 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.367794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894038d1-586a-49b2-b603-b0fbb9886d88 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.368066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894038d1-586a-49b2-b603-b0fbb9886d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.388998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-894038d1-586a-49b2-b603-b0fbb9886d88 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:15.390299 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-894038d1-586a-49b2-b603-b0fbb9886d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:15.399269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1324/2607] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:15.403580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac8610-dfd4-4323-b64a-1bc6f215351d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.413508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac8610-dfd4-4323-b64a-1bc6f215351d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.418110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:15.418795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.419076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.419352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.420084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:28:15.421107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:15.422714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:15.438460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1284/2608] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:28:15.439715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894038d1-586a-49b2-b603-b0fbb9886d88 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.449123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894038d1-586a-49b2-b603-b0fbb9886d88 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.454398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b72c0-7958-4906-a0f5-38ead9c55d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:15.455096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b72c0-7958-4906-a0f5-38ead9c55d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.455375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b72c0-7958-4906-a0f5-38ead9c55d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.455648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b72c0-7958-4906-a0f5-38ead9c55d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.456378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b72c0-7958-4906-a0f5-38ead9c55d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:15.458268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b72c0-7958-4906-a0f5-38ead9c55d88 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:15.484082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1325/2609] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:28:15 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:15.488232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.496979 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:15.501259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eb40f-de3a-4b31-9074-6b6fd57c629c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.569227 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960415cf-1115-4653-a85b-ffd9bf4e03ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:15.569916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960415cf-1115-4653-a85b-ffd9bf4e03ff admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.570198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960415cf-1115-4653-a85b-ffd9bf4e03ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.570476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960415cf-1115-4653-a85b-ffd9bf4e03ff admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.571184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960415cf-1115-4653-a85b-ffd9bf4e03ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:15.573146 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960415cf-1115-4653-a85b-ffd9bf4e03ff admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:15.596972 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1285/2610] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:28:15 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:15.598398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b72c0-7958-4906-a0f5-38ead9c55d88 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.609028 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b72c0-7958-4906-a0f5-38ead9c55d88 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.613850 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be47b0e-6d8d-4f39-840d-af7efc1906a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:15.614524 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be47b0e-6d8d-4f39-840d-af7efc1906a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.614804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be47b0e-6d8d-4f39-840d-af7efc1906a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.615075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be47b0e-6d8d-4f39-840d-af7efc1906a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.615807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be47b0e-6d8d-4f39-840d-af7efc1906a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:15.617440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be47b0e-6d8d-4f39-840d-af7efc1906a5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:15.628789 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1326/2611] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:15.632666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960415cf-1115-4653-a85b-ffd9bf4e03ff admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.643652 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960415cf-1115-4653-a85b-ffd9bf4e03ff admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.648206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3670da5-6059-456b-8aa5-254d0e74ec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:15.648867 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670da5-6059-456b-8aa5-254d0e74ec54 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.649145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670da5-6059-456b-8aa5-254d0e74ec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.649418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670da5-6059-456b-8aa5-254d0e74ec54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.650143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3670da5-6059-456b-8aa5-254d0e74ec54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:15.651737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3670da5-6059-456b-8aa5-254d0e74ec54 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:15.662202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1286/2612] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:15.666302 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be47b0e-6d8d-4f39-840d-af7efc1906a5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.676503 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be47b0e-6d8d-4f39-840d-af7efc1906a5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.681111 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ce934-90fb-485c-aa80-065d363bd59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:15.682080 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ce934-90fb-485c-aa80-065d363bd59c admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.682426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ce934-90fb-485c-aa80-065d363bd59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.682765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ce934-90fb-485c-aa80-065d363bd59c admin admin] PATH_INFO: `/v3/projects/f8aacce628d441d1bff9efb033119278/users/4a053e8f5f004acaad8d5eaf2985ce65/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.697995 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ce934-90fb-485c-aa80-065d363bd59c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8aacce628d441d1bff9efb033119278, user_id=4a053e8f5f004acaad8d5eaf2985ce65, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:15.701693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ce934-90fb-485c-aa80-065d363bd59c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:15.716174 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1327/2613] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:15 2022] PUT /identity/v3/projects/f8aacce628d441d1bff9efb033119278/users/4a053e8f5f004acaad8d5eaf2985ce65/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:15.727185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d11-4de0-4a69-ad74-91d3e4fd7c28 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.727481 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d11-4de0-4a69-ad74-91d3e4fd7c28 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.727761 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d11-4de0-4a69-ad74-91d3e4fd7c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.758741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-aa4e7d11-4de0-4a69-ad74-91d3e4fd7c28 None None] MFA Rules not processed for user `4a053e8f5f004acaad8d5eaf2985ce65`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:15.759929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-aa4e7d11-4de0-4a69-ad74-91d3e4fd7c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:15.822337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1287/2614] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:15.826993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ce934-90fb-485c-aa80-065d363bd59c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.888370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ce934-90fb-485c-aa80-065d363bd59c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.892988 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d4797-ef08-4016-b672-a0d8469507b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:15.893650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d4797-ef08-4016-b672-a0d8469507b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:15.893936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d4797-ef08-4016-b672-a0d8469507b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:15.894241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d4797-ef08-4016-b672-a0d8469507b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:15.894935 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d4797-ef08-4016-b672-a0d8469507b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:15.896878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d4797-ef08-4016-b672-a0d8469507b0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:15.922889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1328/2615] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:28:15 2022] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:15.926698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7d11-4de0-4a69-ad74-91d3e4fd7c28 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:15.938639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7d11-4de0-4a69-ad74-91d3e4fd7c28 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:15.999431 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b18f9-156c-4499-b1d6-5a1ae7f13537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:16.000274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b18f9-156c-4499-b1d6-5a1ae7f13537 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:16.000628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b18f9-156c-4499-b1d6-5a1ae7f13537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:16.000986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b18f9-156c-4499-b1d6-5a1ae7f13537 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:16.001806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b18f9-156c-4499-b1d6-5a1ae7f13537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:16.003743 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b18f9-156c-4499-b1d6-5a1ae7f13537 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:16.024141 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1288/2616] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:28:15 2022] POST /identity/v3/users => generated 306 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:16.027928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d4797-ef08-4016-b672-a0d8469507b0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:16.039120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d4797-ef08-4016-b672-a0d8469507b0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:16.044819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde17b24-b241-486f-8e69-0ae059cb06b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:16.045516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17b24-b241-486f-8e69-0ae059cb06b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:16.045795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17b24-b241-486f-8e69-0ae059cb06b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:16.046068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde17b24-b241-486f-8e69-0ae059cb06b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:16.046798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde17b24-b241-486f-8e69-0ae059cb06b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:16.048556 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde17b24-b241-486f-8e69-0ae059cb06b8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:16.050794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:16.064759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1329/2617] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:16.065954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b18f9-156c-4499-b1d6-5a1ae7f13537 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:16.071900 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:16.078811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b18f9-156c-4499-b1d6-5a1ae7f13537 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:16.089964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2b0d-9604-4289-bfed-20bfc0302a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:16.090950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2b0d-9604-4289-bfed-20bfc0302a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:16.091295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2b0d-9604-4289-bfed-20bfc0302a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:16.091639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2b0d-9604-4289-bfed-20bfc0302a7f admin admin] PATH_INFO: `/v3/projects/72d7ad232c18404ebe64ae1fa79d0b77/users/8db9cbcab0714463ac83b05d8cd8912b/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:16.107324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2b0d-9604-4289-bfed-20bfc0302a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d7ad232c18404ebe64ae1fa79d0b77, user_id=8db9cbcab0714463ac83b05d8cd8912b, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:16.110036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2b0d-9604-4289-bfed-20bfc0302a7f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:16.123580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1289/2618] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:16 2022] PUT /identity/v3/projects/72d7ad232c18404ebe64ae1fa79d0b77/users/8db9cbcab0714463ac83b05d8cd8912b/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:16.127716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde17b24-b241-486f-8e69-0ae059cb06b8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:16.137661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde17b24-b241-486f-8e69-0ae059cb06b8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:16.192039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c79f5-b100-4db8-aa19-86d7bbdf60fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:16.192760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c79f5-b100-4db8-aa19-86d7bbdf60fd admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:16.193053 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c79f5-b100-4db8-aa19-86d7bbdf60fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:16.193319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c79f5-b100-4db8-aa19-86d7bbdf60fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:16.194071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c79f5-b100-4db8-aa19-86d7bbdf60fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:16.195657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c79f5-b100-4db8-aa19-86d7bbdf60fd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:16.205657 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1330/2619] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:16.210010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2b0d-9604-4289-bfed-20bfc0302a7f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:16.221560 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2b0d-9604-4289-bfed-20bfc0302a7f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:16.226137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:16.227024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:16.227295 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:16.227562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] PATH_INFO: `/v3/projects/72d7ad232c18404ebe64ae1fa79d0b77/users/8db9cbcab0714463ac83b05d8cd8912b/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:16.229562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d7ad232c18404ebe64ae1fa79d0b77, user_id=8db9cbcab0714463ac83b05d8cd8912b, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:16.232848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:16.244943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1290/2620] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:16 2022] PUT /identity/v3/projects/72d7ad232c18404ebe64ae1fa79d0b77/users/8db9cbcab0714463ac83b05d8cd8912b/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:16.255878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77a189-8137-4368-942d-32eee23d5253 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:16.256198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77a189-8137-4368-942d-32eee23d5253 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:16.256473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77a189-8137-4368-942d-32eee23d5253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:16.289772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cc77a189-8137-4368-942d-32eee23d5253 None None] MFA Rules not processed for user `8db9cbcab0714463ac83b05d8cd8912b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:16.290997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cc77a189-8137-4368-942d-32eee23d5253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:16.363508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1331/2621] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:16.374399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:16.376232 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:16.439340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887b882-c07a-4814-b29e-77499a75bd7d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:16.444328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d1b54-691f-480a-b9a9-54c58b00abc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:16.444994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d1b54-691f-480a-b9a9-54c58b00abc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:16.445280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d1b54-691f-480a-b9a9-54c58b00abc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:16.445557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d1b54-691f-480a-b9a9-54c58b00abc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:16.455993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d1b54-691f-480a-b9a9-54c58b00abc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:16.457551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d1b54-691f-480a-b9a9-54c58b00abc3 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:16.468922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1291/2622] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:16.542185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77a189-8137-4368-942d-32eee23d5253 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:16.552728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77a189-8137-4368-942d-32eee23d5253 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:16.556336 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6808c-3020-4041-95c0-c03bf49dee8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:16.556982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6808c-3020-4041-95c0-c03bf49dee8e service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:16.557265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6808c-3020-4041-95c0-c03bf49dee8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:16.557535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6808c-3020-4041-95c0-c03bf49dee8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:16.617727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6808c-3020-4041-95c0-c03bf49dee8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:16.619171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6808c-3020-4041-95c0-c03bf49dee8e service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:16.628045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1332/2623] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:20.686521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d1b54-691f-480a-b9a9-54c58b00abc3 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:20.754243 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d1b54-691f-480a-b9a9-54c58b00abc3 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:20.759081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:20.759955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:20.760270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:20.760650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] PATH_INFO: `/v3/users/4a053e8f5f004acaad8d5eaf2985ce65` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:20.762059 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a053e8f5f004acaad8d5eaf2985ce65)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:20.763746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:20.823641 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a053e8f5f004acaad8d5eaf2985ce65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:20.824424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a053e8f5f004acaad8d5eaf2985ce65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:20.837219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a053e8f5f004acaad8d5eaf2985ce65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:20.837956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a053e8f5f004acaad8d5eaf2985ce65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:20.842212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:20.845863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a053e8f5f004acaad8d5eaf2985ce65'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:20.861300 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1292/2624] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:28:20 2022] DELETE /identity/v3/users/4a053e8f5f004acaad8d5eaf2985ce65 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:28:20.865973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24274-e341-4b5a-9bd6-cb65547fb1ef None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:20.866590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24274-e341-4b5a-9bd6-cb65547fb1ef None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:20.866590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24274-e341-4b5a-9bd6-cb65547fb1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:20.885233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b6d24274-e341-4b5a-9bd6-cb65547fb1ef None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:20.886442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b6d24274-e341-4b5a-9bd6-cb65547fb1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:20.900393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:20.948339 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1333/2625] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:20.958502 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:20.960374 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:21.017421 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa2ca0-76c9-4895-b583-59db027bfcb4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:21.021075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54bce2-b8ec-4f60-a967-a0f97031683d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:21.021719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54bce2-b8ec-4f60-a967-a0f97031683d service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:21.022004 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54bce2-b8ec-4f60-a967-a0f97031683d service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:21.022280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54bce2-b8ec-4f60-a967-a0f97031683d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:21.031812 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54bce2-b8ec-4f60-a967-a0f97031683d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:21.033279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54bce2-b8ec-4f60-a967-a0f97031683d service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:21.042697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1293/2626] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:21.322117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d24274-e341-4b5a-9bd6-cb65547fb1ef None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:21.323682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b6d24274-e341-4b5a-9bd6-cb65547fb1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:21.335972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d24274-e341-4b5a-9bd6-cb65547fb1ef None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:21.340680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:21.342087 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:21.342371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:21.342703 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] PATH_INFO: `/v3/projects/f8aacce628d441d1bff9efb033119278` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:21.343895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8aacce628d441d1bff9efb033119278)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:21.345835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:21.393849 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8aacce628d441d1bff9efb033119278', 'request_id': 'req-1993f190-0736-4c52-9fbe-72e68a95b41c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.399823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8aacce628d441d1bff9efb033119278', 'request_id': 'req-1993f190-0736-4c52-9fbe-72e68a95b41c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.407652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8aacce628d441d1bff9efb033119278', 'request_id': 'req-1993f190-0736-4c52-9fbe-72e68a95b41c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.417997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] The token cache is being invalidate because project f8aacce628d441d1bff9efb033119278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:28:21.418285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.418910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.420509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1334/2627] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:28:21 2022] DELETE /identity/v3/projects/f8aacce628d441d1bff9efb033119278 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:21.424573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54bce2-b8ec-4f60-a967-a0f97031683d service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:21.434396 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54bce2-b8ec-4f60-a967-a0f97031683d service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:21.491768 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:21.492726 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:21.493017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:21.493294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] PATH_INFO: `/v3/users/8db9cbcab0714463ac83b05d8cd8912b` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:21.494475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db9cbcab0714463ac83b05d8cd8912b)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:21.496469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:21.542044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db9cbcab0714463ac83b05d8cd8912b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.542687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db9cbcab0714463ac83b05d8cd8912b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.554760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db9cbcab0714463ac83b05d8cd8912b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.555387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db9cbcab0714463ac83b05d8cd8912b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.563916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-7da97121-3d79-4394-b632-025c90a96949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db9cbcab0714463ac83b05d8cd8912b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:21.576608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1294/2628] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:28:21 2022] DELETE /identity/v3/users/8db9cbcab0714463ac83b05d8cd8912b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:28:21.862159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:21.863743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:21.878699 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993f190-0736-4c52-9fbe-72e68a95b41c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:21.942942 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:21.943829 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:21.944133 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:21.944426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] PATH_INFO: `/v3/projects/72d7ad232c18404ebe64ae1fa79d0b77` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:21.945652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d7ad232c18404ebe64ae1fa79d0b77)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:21.947565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:21.996224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:22.000574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d7ad232c18404ebe64ae1fa79d0b77', 'request_id': 'req-54d9eae9-c874-4669-acfa-7c7c220c1874'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:22.008500 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d7ad232c18404ebe64ae1fa79d0b77', 'request_id': 'req-54d9eae9-c874-4669-acfa-7c7c220c1874'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:22.016509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d7ad232c18404ebe64ae1fa79d0b77', 'request_id': 'req-54d9eae9-c874-4669-acfa-7c7c220c1874'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:22.027977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] The token cache is being invalidate because project 72d7ad232c18404ebe64ae1fa79d0b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:28:22.028295 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:22.029629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-54d9eae9-c874-4669-acfa-7c7c220c1874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:22.031163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1335/2629] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:28:21 2022] DELETE /identity/v3/projects/72d7ad232c18404ebe64ae1fa79d0b77 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:22.036234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f21ba-e11d-4a6e-8161-f43389706e5a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.036838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f21ba-e11d-4a6e-8161-f43389706e5a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.036838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f21ba-e11d-4a6e-8161-f43389706e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.057230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4b9f21ba-e11d-4a6e-8161-f43389706e5a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:22.059093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4b9f21ba-e11d-4a6e-8161-f43389706e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:22.064298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:22.135776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1295/2630] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:22.146135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9bb6d-6885-49b7-ad5c-fa268fe0bd86 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.146533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9bb6d-6885-49b7-ad5c-fa268fe0bd86 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.146912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9bb6d-6885-49b7-ad5c-fa268fe0bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.165981 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a8a9bb6d-6885-49b7-ad5c-fa268fe0bd86 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:22.170051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a8a9bb6d-6885-49b7-ad5c-fa268fe0bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:22.181420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1336/2631] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:22.185237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f21ba-e11d-4a6e-8161-f43389706e5a None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.194858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f21ba-e11d-4a6e-8161-f43389706e5a None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.199508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.200196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.200478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.201299 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.202028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:28:22.202329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.203910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.215910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1296/2632] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:28:22.225572 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9bb6d-6885-49b7-ad5c-fa268fe0bd86 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.230911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9bb6d-6885-49b7-ad5c-fa268fe0bd86 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.235656 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fd9a6-6ba4-4f77-8200-da18f176596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.236359 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd9a6-6ba4-4f77-8200-da18f176596f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.236673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd9a6-6ba4-4f77-8200-da18f176596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.236954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd9a6-6ba4-4f77-8200-da18f176596f admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.237683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fd9a6-6ba4-4f77-8200-da18f176596f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.239590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fd9a6-6ba4-4f77-8200-da18f176596f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.268153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1337/2633] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:28:22 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:22.272390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.284448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df11fe-ddd6-4556-9e29-5c4bf463e0d5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.350051 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3b8b4-5b05-4ed1-b338-75da3e1cfcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.350806 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b8b4-5b05-4ed1-b338-75da3e1cfcad admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.351137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b8b4-5b05-4ed1-b338-75da3e1cfcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.351435 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3b8b4-5b05-4ed1-b338-75da3e1cfcad admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.352294 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3b8b4-5b05-4ed1-b338-75da3e1cfcad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.354197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3b8b4-5b05-4ed1-b338-75da3e1cfcad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.377616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1297/2634] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:28:22 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:28:22.378844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fd9a6-6ba4-4f77-8200-da18f176596f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.390701 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fd9a6-6ba4-4f77-8200-da18f176596f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.395765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4eb8a-d060-491d-a98b-80f7692ebade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.396554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4eb8a-d060-491d-a98b-80f7692ebade admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.396726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4eb8a-d060-491d-a98b-80f7692ebade admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.397009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4eb8a-d060-491d-a98b-80f7692ebade admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.397744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4eb8a-d060-491d-a98b-80f7692ebade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.399348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4eb8a-d060-491d-a98b-80f7692ebade admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.410781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1338/2635] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:22.415000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3b8b4-5b05-4ed1-b338-75da3e1cfcad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.425204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3b8b4-5b05-4ed1-b338-75da3e1cfcad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.430169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acafa28-f1f9-4eee-9cb6-64f944ec6d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.430883 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafa28-f1f9-4eee-9cb6-64f944ec6d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.431167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafa28-f1f9-4eee-9cb6-64f944ec6d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.431443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acafa28-f1f9-4eee-9cb6-64f944ec6d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.432211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acafa28-f1f9-4eee-9cb6-64f944ec6d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.433973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acafa28-f1f9-4eee-9cb6-64f944ec6d42 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.444828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1298/2636] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:22.449092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4eb8a-d060-491d-a98b-80f7692ebade admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.460756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4eb8a-d060-491d-a98b-80f7692ebade admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.466233 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02953a3b-81ec-46fc-966a-4b0746f382ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.467767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953a3b-81ec-46fc-966a-4b0746f382ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.468137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953a3b-81ec-46fc-966a-4b0746f382ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.468383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02953a3b-81ec-46fc-966a-4b0746f382ad admin admin] PATH_INFO: `/v3/projects/a0642b61c91348629067d04a39bf695e/users/c64cfd48260a46fc95a46de469f5e893/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.484924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02953a3b-81ec-46fc-966a-4b0746f382ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0642b61c91348629067d04a39bf695e, user_id=c64cfd48260a46fc95a46de469f5e893, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.487668 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02953a3b-81ec-46fc-966a-4b0746f382ad admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.503018 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1339/2637] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:22 2022] PUT /identity/v3/projects/a0642b61c91348629067d04a39bf695e/users/c64cfd48260a46fc95a46de469f5e893/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:28:22.519997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a5f55-b900-4e89-92d3-19bb7a7b9ed5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.520313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a5f55-b900-4e89-92d3-19bb7a7b9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.520595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a5f55-b900-4e89-92d3-19bb7a7b9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.551355 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-b90a5f55-b900-4e89-92d3-19bb7a7b9ed5 None None] MFA Rules not processed for user `c64cfd48260a46fc95a46de469f5e893`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:22.552654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b90a5f55-b900-4e89-92d3-19bb7a7b9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:22.622223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1299/2638] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:22.627243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02953a3b-81ec-46fc-966a-4b0746f382ad admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.692137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02953a3b-81ec-46fc-966a-4b0746f382ad admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.697113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb8d15-ee05-430b-9516-a1373eb0cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.697832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb8d15-ee05-430b-9516-a1373eb0cacf admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.698112 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb8d15-ee05-430b-9516-a1373eb0cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.698386 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb8d15-ee05-430b-9516-a1373eb0cacf admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.699099 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb8d15-ee05-430b-9516-a1373eb0cacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.701684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb8d15-ee05-430b-9516-a1373eb0cacf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.734627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1340/2639] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:28:22 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:22.736124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a5f55-b900-4e89-92d3-19bb7a7b9ed5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.743455 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:22.748677 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a5f55-b900-4e89-92d3-19bb7a7b9ed5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.804448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442835b2-e8bd-471b-839b-c1f07fc6ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.805119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442835b2-e8bd-471b-839b-c1f07fc6ceae admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.805406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442835b2-e8bd-471b-839b-c1f07fc6ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.805687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442835b2-e8bd-471b-839b-c1f07fc6ceae admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.806389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442835b2-e8bd-471b-839b-c1f07fc6ceae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.808339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442835b2-e8bd-471b-839b-c1f07fc6ceae admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.828954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1300/2640] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:28:22 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:22.832821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb8d15-ee05-430b-9516-a1373eb0cacf admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.844728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb8d15-ee05-430b-9516-a1373eb0cacf admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.849340 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d7d09-1adf-41ff-ba33-cd29087b34bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.850007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d7d09-1adf-41ff-ba33-cd29087b34bb admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.850294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d7d09-1adf-41ff-ba33-cd29087b34bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.850575 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d7d09-1adf-41ff-ba33-cd29087b34bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.851303 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d7d09-1adf-41ff-ba33-cd29087b34bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.852941 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d7d09-1adf-41ff-ba33-cd29087b34bb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.865230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1341/2641] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:22.869318 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442835b2-e8bd-471b-839b-c1f07fc6ceae admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.880250 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442835b2-e8bd-471b-839b-c1f07fc6ceae admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.884950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0f711-7468-4547-8b20-30a97b795f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.885825 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0f711-7468-4547-8b20-30a97b795f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.886110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0f711-7468-4547-8b20-30a97b795f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.886388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0f711-7468-4547-8b20-30a97b795f5b admin admin] PATH_INFO: `/v3/projects/91cb09c1002e444da46f724f3d46d46f/users/f31b437785e4421c91e34b00b295c93d/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.902076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0f711-7468-4547-8b20-30a97b795f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cb09c1002e444da46f724f3d46d46f, user_id=f31b437785e4421c91e34b00b295c93d, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.904803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0f711-7468-4547-8b20-30a97b795f5b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:22.918382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1301/2642] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:22 2022] PUT /identity/v3/projects/91cb09c1002e444da46f724f3d46d46f/users/f31b437785e4421c91e34b00b295c93d/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:22.922862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d7d09-1adf-41ff-ba33-cd29087b34bb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:22.933023 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d7d09-1adf-41ff-ba33-cd29087b34bb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:22.971760 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:22.990417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5cd48-45f4-450d-b5c5-4fbc63c4b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:22.991085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5cd48-45f4-450d-b5c5-4fbc63c4b293 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:22.991370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5cd48-45f4-450d-b5c5-4fbc63c4b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:22.991648 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5cd48-45f4-450d-b5c5-4fbc63c4b293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:22.992412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5cd48-45f4-450d-b5c5-4fbc63c4b293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:22.994010 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5cd48-45f4-450d-b5c5-4fbc63c4b293 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:23.004499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1342/2643] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:28:23.009076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0f711-7468-4547-8b20-30a97b795f5b admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:23.019472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0f711-7468-4547-8b20-30a97b795f5b admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:23.023969 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:23.024876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:23.025156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:23.025424 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] PATH_INFO: `/v3/projects/91cb09c1002e444da46f724f3d46d46f/users/f31b437785e4421c91e34b00b295c93d/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:23.027429 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cb09c1002e444da46f724f3d46d46f, user_id=f31b437785e4421c91e34b00b295c93d, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:23.030171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:23.040388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1302/2644] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:23 2022] PUT /identity/v3/projects/91cb09c1002e444da46f724f3d46d46f/users/f31b437785e4421c91e34b00b295c93d/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:23.051663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3528d-8e48-4100-b5b8-4daa1b976a24 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:23.051958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3528d-8e48-4100-b5b8-4daa1b976a24 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:23.052274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3528d-8e48-4100-b5b8-4daa1b976a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:23.078597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-aff3528d-8e48-4100-b5b8-4daa1b976a24 None None] MFA Rules not processed for user `f31b437785e4421c91e34b00b295c93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:23.079827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-aff3528d-8e48-4100-b5b8-4daa1b976a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:23.147073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1343/2645] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:23.157511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:23.159224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:23.216848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4c919-852c-453d-b53c-768b77f9b27a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:23.220679 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f032d-94a3-481e-a0c5-32c8cea2fca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:23.221332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f032d-94a3-481e-a0c5-32c8cea2fca6 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:23.221611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f032d-94a3-481e-a0c5-32c8cea2fca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:23.221917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f032d-94a3-481e-a0c5-32c8cea2fca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:23.231239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f032d-94a3-481e-a0c5-32c8cea2fca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:23.233310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f032d-94a3-481e-a0c5-32c8cea2fca6 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:23.242611 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1303/2646] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:23.376959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3528d-8e48-4100-b5b8-4daa1b976a24 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:23.437484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3528d-8e48-4100-b5b8-4daa1b976a24 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:23.441874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:23.442743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:23.443026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:23.443306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] PATH_INFO: `/v3/users/c64cfd48260a46fc95a46de469f5e893` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:23.444504 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64cfd48260a46fc95a46de469f5e893)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:23.446410 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:23.491952 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64cfd48260a46fc95a46de469f5e893'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:23.492640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64cfd48260a46fc95a46de469f5e893'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:23.499620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64cfd48260a46fc95a46de469f5e893'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:23.506933 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64cfd48260a46fc95a46de469f5e893'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:23.507568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64cfd48260a46fc95a46de469f5e893'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:23.509538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:23.527607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1344/2647] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:28:23 2022] DELETE /identity/v3/users/c64cfd48260a46fc95a46de469f5e893 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:23.532785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c8093-8d2e-427a-b8ab-abcf0d849f31 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:23.533079 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c8093-8d2e-427a-b8ab-abcf0d849f31 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:23.533356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c8093-8d2e-427a-b8ab-abcf0d849f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:23.551550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-de1c8093-8d2e-427a-b8ab-abcf0d849f31 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:23.552815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-de1c8093-8d2e-427a-b8ab-abcf0d849f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:23.601960 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:23.611576 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1304/2648] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:23.621367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:23.623130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:23.680194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb05909-33d2-459a-abd1-24968f5f8407 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:23.683817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79cd57-95b6-4daf-a287-849e3757537b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:23.684494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79cd57-95b6-4daf-a287-849e3757537b service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:23.684779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79cd57-95b6-4daf-a287-849e3757537b service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:23.685055 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79cd57-95b6-4daf-a287-849e3757537b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:23.694485 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79cd57-95b6-4daf-a287-849e3757537b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:23.695894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79cd57-95b6-4daf-a287-849e3757537b service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:23.705774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1345/2649] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:24.128601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c8093-8d2e-427a-b8ab-abcf0d849f31 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:24.130165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-de1c8093-8d2e-427a-b8ab-abcf0d849f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:24.144496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c8093-8d2e-427a-b8ab-abcf0d849f31 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:24.149546 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:24.150494 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:24.150839 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:24.151176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] PATH_INFO: `/v3/projects/a0642b61c91348629067d04a39bf695e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:24.152480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0642b61c91348629067d04a39bf695e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:24.154458 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:24.203065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0642b61c91348629067d04a39bf695e', 'request_id': 'req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.208998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0642b61c91348629067d04a39bf695e', 'request_id': 'req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.223071 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0642b61c91348629067d04a39bf695e', 'request_id': 'req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.235103 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] The token cache is being invalidate because project a0642b61c91348629067d04a39bf695e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:28:24.235368 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.236007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.238302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1305/2650] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:28:24 2022] DELETE /identity/v3/projects/a0642b61c91348629067d04a39bf695e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:24.242781 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79cd57-95b6-4daf-a287-849e3757537b service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:24.254288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79cd57-95b6-4daf-a287-849e3757537b service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:24.315100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:24.315985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:24.316370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:24.316647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] PATH_INFO: `/v3/users/f31b437785e4421c91e34b00b295c93d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:24.317831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31b437785e4421c91e34b00b295c93d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:24.319819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:24.368923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31b437785e4421c91e34b00b295c93d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.369706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31b437785e4421c91e34b00b295c93d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.380116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31b437785e4421c91e34b00b295c93d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.388420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31b437785e4421c91e34b00b295c93d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.389199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31b437785e4421c91e34b00b295c93d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:24.406778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1346/2651] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:28:24 2022] DELETE /identity/v3/users/f31b437785e4421c91e34b00b295c93d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:28:24.776622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:24.778603 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:24.870835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb22d2-98dd-48ea-9df9-0f2d76d6b39e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:24.941617 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:24.944135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:24.946195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151b584-b8f8-4f4e-8acf-37c87f4ce2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:24.946909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151b584-b8f8-4f4e-8acf-37c87f4ce2bb service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:24.947197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151b584-b8f8-4f4e-8acf-37c87f4ce2bb service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:24.947472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151b584-b8f8-4f4e-8acf-37c87f4ce2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:24.949314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-8151b584-b8f8-4f4e-8acf-37c87f4ce2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:24.951946 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:24.964090 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151b584-b8f8-4f4e-8acf-37c87f4ce2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:24.965741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151b584-b8f8-4f4e-8acf-37c87f4ce2bb service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:24.980470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1306/2652] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:25.027878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16371972-8de1-4909-b0ef-62ac88791026 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:25.033530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:25.034453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.034735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.035009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] PATH_INFO: `/v3/projects/91cb09c1002e444da46f724f3d46d46f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.036232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cb09c1002e444da46f724f3d46d46f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:25.038127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:25.086350 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cb09c1002e444da46f724f3d46d46f', 'request_id': 'req-6ad64835-f83e-4426-9a48-0142ba815d5b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:25.094203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cb09c1002e444da46f724f3d46d46f', 'request_id': 'req-6ad64835-f83e-4426-9a48-0142ba815d5b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:25.103363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cb09c1002e444da46f724f3d46d46f', 'request_id': 'req-6ad64835-f83e-4426-9a48-0142ba815d5b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:25.114869 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] The token cache is being invalidate because project 91cb09c1002e444da46f724f3d46d46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:28:25.115186 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:25.115802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ad64835-f83e-4426-9a48-0142ba815d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:25.117411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1347/2653] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:28:24 2022] DELETE /identity/v3/projects/91cb09c1002e444da46f724f3d46d46f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:28:25.122382 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a85b5-19d0-48f0-96d9-9b5826d123c0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.122803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a85b5-19d0-48f0-96d9-9b5826d123c0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.123156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a85b5-19d0-48f0-96d9-9b5826d123c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.135949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:25.142828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c86a85b5-19d0-48f0-96d9-9b5826d123c0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:25.145360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c86a85b5-19d0-48f0-96d9-9b5826d123c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:25.209308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1307/2654] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:25.219382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40242bb4-91d9-4624-9ecc-ad599260815e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.219778 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40242bb4-91d9-4624-9ecc-ad599260815e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.220154 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40242bb4-91d9-4624-9ecc-ad599260815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.241282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-40242bb4-91d9-4624-9ecc-ad599260815e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:25.245661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-40242bb4-91d9-4624-9ecc-ad599260815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:25.255454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1348/2655] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:25.259917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a85b5-19d0-48f0-96d9-9b5826d123c0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:25.271282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a85b5-19d0-48f0-96d9-9b5826d123c0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:25.275956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:25.276647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.276934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.277211 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.277975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:28:25.278286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:25.280554 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:25.293559 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1308/2656] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:28:25.299164 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40242bb4-91d9-4624-9ecc-ad599260815e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:25.315484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40242bb4-91d9-4624-9ecc-ad599260815e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:25.320342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5305-6081-4607-9a19-a5280c683c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:25.321003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5305-6081-4607-9a19-a5280c683c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.321288 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5305-6081-4607-9a19-a5280c683c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.321614 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5305-6081-4607-9a19-a5280c683c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.322557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d5305-6081-4607-9a19-a5280c683c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:25.324798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d5305-6081-4607-9a19-a5280c683c38 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:25.352680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1349/2657] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:28:25 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:25.356923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:25.366974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef38d71-00e8-4421-9afc-45d7eabc6c47 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:25.422958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17471ece-3aeb-463e-8ab0-9dfbf3164928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:25.423627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17471ece-3aeb-463e-8ab0-9dfbf3164928 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.423914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17471ece-3aeb-463e-8ab0-9dfbf3164928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.424222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17471ece-3aeb-463e-8ab0-9dfbf3164928 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.424921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17471ece-3aeb-463e-8ab0-9dfbf3164928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:25.426838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17471ece-3aeb-463e-8ab0-9dfbf3164928 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:25.446343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1309/2658] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:28:25 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:25.451153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5305-6081-4607-9a19-a5280c683c38 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:25.461708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5305-6081-4607-9a19-a5280c683c38 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:25.467113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc73b1-c203-456a-8220-dd0369db4d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:25.467765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc73b1-c203-456a-8220-dd0369db4d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.468045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc73b1-c203-456a-8220-dd0369db4d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.468355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc73b1-c203-456a-8220-dd0369db4d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.469079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc73b1-c203-456a-8220-dd0369db4d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:25.470670 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc73b1-c203-456a-8220-dd0369db4d70 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:25.482044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1350/2659] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:25.486069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17471ece-3aeb-463e-8ab0-9dfbf3164928 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:25.495928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17471ece-3aeb-463e-8ab0-9dfbf3164928 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:25.501594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ca3b4-703b-4d6d-9a2c-7a6968f1f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:25.501809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ca3b4-703b-4d6d-9a2c-7a6968f1f189 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.502091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ca3b4-703b-4d6d-9a2c-7a6968f1f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.502360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ca3b4-703b-4d6d-9a2c-7a6968f1f189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.503077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ca3b4-703b-4d6d-9a2c-7a6968f1f189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:25.504701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ca3b4-703b-4d6d-9a2c-7a6968f1f189 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:25.515064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1310/2660] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:25.519169 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc73b1-c203-456a-8220-dd0369db4d70 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:25.529271 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc73b1-c203-456a-8220-dd0369db4d70 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:25.534069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:25.534949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.535226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.535495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] PATH_INFO: `/v3/projects/2c37990b166041e2a66e5136634a5274/users/c7b17f6a722243279c86b42e8300f556/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.549738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c37990b166041e2a66e5136634a5274, user_id=c7b17f6a722243279c86b42e8300f556, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:25.552403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:25.566224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1351/2661] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:25 2022] PUT /identity/v3/projects/2c37990b166041e2a66e5136634a5274/users/c7b17f6a722243279c86b42e8300f556/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:25.571302 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b3fd-523f-4d93-8e5b-0a5128ccedb0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.571594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b3fd-523f-4d93-8e5b-0a5128ccedb0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.571875 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b3fd-523f-4d93-8e5b-0a5128ccedb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.590282 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-ee59b3fd-523f-4d93-8e5b-0a5128ccedb0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:25.591521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ee59b3fd-523f-4d93-8e5b-0a5128ccedb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:25.651548 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1311/2662] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:25.661680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:25.663417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:25.697121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:25.722317 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488559-e240-4edb-a7c9-c411f85ec09b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:25.725975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21ba3-710f-44f3-84cb-ddf75529101c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:25.726619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21ba3-710f-44f3-84cb-ddf75529101c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:25.726903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21ba3-710f-44f3-84cb-ddf75529101c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:25.727179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21ba3-710f-44f3-84cb-ddf75529101c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:25.736039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca21ba3-710f-44f3-84cb-ddf75529101c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:25.737496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca21ba3-710f-44f3-84cb-ddf75529101c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:25.746757 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1352/2663] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:26.402335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06d89-a2b3-4da3-8522-57708f185e54 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:26.402811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06d89-a2b3-4da3-8522-57708f185e54 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:26.402925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e06d89-a2b3-4da3-8522-57708f185e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:26.428040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:26.441448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-46e06d89-a2b3-4da3-8522-57708f185e54 None None] MFA Rules not processed for user `c7b17f6a722243279c86b42e8300f556`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:26.442767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-46e06d89-a2b3-4da3-8522-57708f185e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:26.520531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1312/2664] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:26.526241 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21ba3-710f-44f3-84cb-ddf75529101c service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:26.542609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21ba3-710f-44f3-84cb-ddf75529101c service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:26.547643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a4083-3d0a-45b5-82fa-79329be0de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:26.548428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4083-3d0a-45b5-82fa-79329be0de31 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:26.548640 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4083-3d0a-45b5-82fa-79329be0de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:26.548947 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a4083-3d0a-45b5-82fa-79329be0de31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:26.549619 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a4083-3d0a-45b5-82fa-79329be0de31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:26.551533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a4083-3d0a-45b5-82fa-79329be0de31 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:26.580845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1353/2665] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:28:26 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:26.584931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e06d89-a2b3-4da3-8522-57708f185e54 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:26.600154 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e06d89-a2b3-4da3-8522-57708f185e54 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:26.660337 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc3c6b-72b6-4da1-b932-0a0fb3c05d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:26.661631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3c6b-72b6-4da1-b932-0a0fb3c05d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:26.661917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3c6b-72b6-4da1-b932-0a0fb3c05d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:26.662191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc3c6b-72b6-4da1-b932-0a0fb3c05d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:26.662903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc3c6b-72b6-4da1-b932-0a0fb3c05d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:26.664870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc3c6b-72b6-4da1-b932-0a0fb3c05d63 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:26.688135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1313/2666] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:28:26 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:28:26.691491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a4083-3d0a-45b5-82fa-79329be0de31 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:26.702113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a4083-3d0a-45b5-82fa-79329be0de31 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:26.707708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356919d-f05c-4588-8280-528461680586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:26.708408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356919d-f05c-4588-8280-528461680586 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:26.709203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356919d-f05c-4588-8280-528461680586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:26.709486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356919d-f05c-4588-8280-528461680586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:26.710215 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356919d-f05c-4588-8280-528461680586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:26.711805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356919d-f05c-4588-8280-528461680586 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:26.723046 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1354/2667] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:26.727212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc3c6b-72b6-4da1-b932-0a0fb3c05d63 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:26.738293 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc3c6b-72b6-4da1-b932-0a0fb3c05d63 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:26.742964 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001821f-ede1-445b-8157-1fd14732c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:26.743932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001821f-ede1-445b-8157-1fd14732c950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:26.744312 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001821f-ede1-445b-8157-1fd14732c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:26.744654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001821f-ede1-445b-8157-1fd14732c950 admin admin] PATH_INFO: `/v3/projects/1455010823c04e428a41ca438f0342ea/users/0525f558d605477fbf1bdd810683098c/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:26.761192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001821f-ede1-445b-8157-1fd14732c950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1455010823c04e428a41ca438f0342ea, user_id=0525f558d605477fbf1bdd810683098c, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:26.764252 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001821f-ede1-445b-8157-1fd14732c950 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:26.777608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1314/2668] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:26 2022] PUT /identity/v3/projects/1455010823c04e428a41ca438f0342ea/users/0525f558d605477fbf1bdd810683098c/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:26.782396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356919d-f05c-4588-8280-528461680586 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:26.792578 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356919d-f05c-4588-8280-528461680586 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:26.855754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd735-b7a2-4c34-bcf7-91bbd2f08dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:26.856509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd735-b7a2-4c34-bcf7-91bbd2f08dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:26.857308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd735-b7a2-4c34-bcf7-91bbd2f08dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:26.857591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd735-b7a2-4c34-bcf7-91bbd2f08dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:26.858497 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd735-b7a2-4c34-bcf7-91bbd2f08dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:26.860120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd735-b7a2-4c34-bcf7-91bbd2f08dd2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:26.870315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1355/2669] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:28:26.875134 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001821f-ede1-445b-8157-1fd14732c950 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:26.888552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001821f-ede1-445b-8157-1fd14732c950 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:26.890951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af391d98-3a73-490a-93f4-5409300796e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:26.891907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391d98-3a73-490a-93f4-5409300796e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:26.892357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391d98-3a73-490a-93f4-5409300796e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:26.892684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af391d98-3a73-490a-93f4-5409300796e3 admin admin] PATH_INFO: `/v3/projects/1455010823c04e428a41ca438f0342ea/users/0525f558d605477fbf1bdd810683098c/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:26.894709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af391d98-3a73-490a-93f4-5409300796e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1455010823c04e428a41ca438f0342ea, user_id=0525f558d605477fbf1bdd810683098c, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:26.897483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af391d98-3a73-490a-93f4-5409300796e3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:26.908909 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1315/2670] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:26 2022] PUT /identity/v3/projects/1455010823c04e428a41ca438f0342ea/users/0525f558d605477fbf1bdd810683098c/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:27.554379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce247-2de1-4cb2-8ee0-1eaaa2ac0eb4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:27.555009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce247-2de1-4cb2-8ee0-1eaaa2ac0eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:27.555009 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce247-2de1-4cb2-8ee0-1eaaa2ac0eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:27.583404 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-919ce247-2de1-4cb2-8ee0-1eaaa2ac0eb4 None None] MFA Rules not processed for user `0525f558d605477fbf1bdd810683098c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:27.584923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-919ce247-2de1-4cb2-8ee0-1eaaa2ac0eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:27.676702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1356/2671] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:27.682686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdefb44-e50e-4c8b-a522-8d7cbd69912f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:27.683566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdefb44-e50e-4c8b-a522-8d7cbd69912f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:27.684010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdefb44-e50e-4c8b-a522-8d7cbd69912f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:27.741279 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-bcdefb44-e50e-4c8b-a522-8d7cbd69912f None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:27.742856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bcdefb44-e50e-4c8b-a522-8d7cbd69912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:27.744066 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda8a5-5d5e-48ae-befe-c9ca24df3716 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:27.744399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda8a5-5d5e-48ae-befe-c9ca24df3716 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:27.744680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cda8a5-5d5e-48ae-befe-c9ca24df3716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:27.763926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-66cda8a5-5d5e-48ae-befe-c9ca24df3716 None None] MFA Rules not processed for user `c7b17f6a722243279c86b42e8300f556`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:27.765206 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-66cda8a5-5d5e-48ae-befe-c9ca24df3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:27.774262 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:27.782998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:27.818059 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1316/2672] 10.222.0.17 () {58 vars in 1009 bytes} [Thu Jul 14 11:28:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:27.823463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1357/2673] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:28:27.834569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdefb44-e50e-4c8b-a522-8d7cbd69912f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:27.835993 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-bcdefb44-e50e-4c8b-a522-8d7cbd69912f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:27.869782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cda8a5-5d5e-48ae-befe-c9ca24df3716 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:27.871187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-66cda8a5-5d5e-48ae-befe-c9ca24df3716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:27.911276 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdefb44-e50e-4c8b-a522-8d7cbd69912f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:27.917042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:27.917694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:27.917985 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:27.918245 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:27.929388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:27.929388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:27.941854 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1317/2674] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:27.966929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cda8a5-5d5e-48ae-befe-c9ca24df3716 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:27.972251 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ff54-92b2-4834-9930-628b2bd3015d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:27.972904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ff54-92b2-4834-9930-628b2bd3015d service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:27.973187 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ff54-92b2-4834-9930-628b2bd3015d service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:27.973471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ff54-92b2-4834-9930-628b2bd3015d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:27.982071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ff54-92b2-4834-9930-628b2bd3015d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:27.983663 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63ff54-92b2-4834-9930-628b2bd3015d service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:27.992764 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1358/2675] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 11:28:37.934510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=49 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:37.988982 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=56 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:41.308579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:41.312462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:41.388099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c19162-7f68-4450-a2cb-447e96216c3f service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:41.392694 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e97048-f487-44b0-a7b9-9abe576e67f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:41.393440 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97048-f487-44b0-a7b9-9abe576e67f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:41.393795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97048-f487-44b0-a7b9-9abe576e67f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:41.394082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97048-f487-44b0-a7b9-9abe576e67f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:41.404330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e97048-f487-44b0-a7b9-9abe576e67f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:41.405789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e97048-f487-44b0-a7b9-9abe576e67f5 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:41.416709 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1318/2676] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:43.455975 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32006-5c96-48d1-bd41-ede6b8c87b1d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:43.456748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32006-5c96-48d1-bd41-ede6b8c87b1d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:43.458486 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32006-5c96-48d1-bd41-ede6b8c87b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:43.477347 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e7a32006-5c96-48d1-bd41-ede6b8c87b1d None None] MFA Rules not processed for user `e3152e449d7546ed92690a7b58ae027c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:43.478565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e7a32006-5c96-48d1-bd41-ede6b8c87b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:43.487667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1359/2677] 10.222.0.17 () {58 vars in 967 bytes} [Thu Jul 14 11:28:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:43.507217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e97048-f487-44b0-a7b9-9abe576e67f5 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:43.519730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e97048-f487-44b0-a7b9-9abe576e67f5 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:43.532076 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b3202-b3fa-4308-af15-ab1983e54520 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23cd2e48acd9491cb513274c8ce3641f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:43.532823 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b3202-b3fa-4308-af15-ab1983e54520 service swift] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:43.533106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b3202-b3fa-4308-af15-ab1983e54520 service swift] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:43.533381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b3202-b3fa-4308-af15-ab1983e54520 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:43.543418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b3202-b3fa-4308-af15-ab1983e54520 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:43.545492 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b3202-b3fa-4308-af15-ab1983e54520 service swift] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:43.554473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1319/2678] 10.222.0.17 () {60 vars in 1384 bytes} [Thu Jul 14 11:28:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 11:28:45.475136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a32006-5c96-48d1-bd41-ede6b8c87b1d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:45.476667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e7a32006-5c96-48d1-bd41-ede6b8c87b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:45.552194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a32006-5c96-48d1-bd41-ede6b8c87b1d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:45.556595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:45.557465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:45.557770 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:45.558044 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] PATH_INFO: `/v3/users/f6147e389f56479fb9021b03d7af664c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:45.559274 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6147e389f56479fb9021b03d7af664c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:45.561276 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:45.609139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6147e389f56479fb9021b03d7af664c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.609845 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6147e389f56479fb9021b03d7af664c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.617557 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6147e389f56479fb9021b03d7af664c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.625345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6147e389f56479fb9021b03d7af664c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.626236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-56502ebf-0c29-4109-ba4b-bf6b60900c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6147e389f56479fb9021b03d7af664c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.643993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1360/2679] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:28:45 2022] DELETE /identity/v3/users/f6147e389f56479fb9021b03d7af664c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:45.820618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b3202-b3fa-4308-af15-ab1983e54520 service swift] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:45.834856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b3202-b3fa-4308-af15-ab1983e54520 service swift] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:45.903595 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:45.904665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:45.904972 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:45.905307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] PATH_INFO: `/v3/projects/86a0597dfef54b39a27a6772c5a24525` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:45.906664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a0597dfef54b39a27a6772c5a24525)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:45.908811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:45.964518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a0597dfef54b39a27a6772c5a24525', 'request_id': 'req-4ae32261-bbf8-4901-90a4-77a0c635169a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.971261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a0597dfef54b39a27a6772c5a24525', 'request_id': 'req-4ae32261-bbf8-4901-90a4-77a0c635169a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.980484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a0597dfef54b39a27a6772c5a24525', 'request_id': 'req-4ae32261-bbf8-4901-90a4-77a0c635169a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.993564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] The token cache is being invalidate because project 86a0597dfef54b39a27a6772c5a24525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:28:45.993844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.994569 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4ae32261-bbf8-4901-90a4-77a0c635169a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:28:45.996629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1320/2680] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:28:45 2022] DELETE /identity/v3/projects/86a0597dfef54b39a27a6772c5a24525 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:28:46.004976 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87132a-1090-4876-b105-ef40d74854da None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.005686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87132a-1090-4876-b105-ef40d74854da None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.006284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87132a-1090-4876-b105-ef40d74854da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.029611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-be87132a-1090-4876-b105-ef40d74854da None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:46.030841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be87132a-1090-4876-b105-ef40d74854da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:46.092680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1361/2681] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:46.100340 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c0ca-0d23-474e-91ff-be4501b5342c None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.100572 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c0ca-0d23-474e-91ff-be4501b5342c None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.100852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073c0ca-0d23-474e-91ff-be4501b5342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.119796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e073c0ca-0d23-474e-91ff-be4501b5342c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:46.121069 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e073c0ca-0d23-474e-91ff-be4501b5342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:46.129738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1321/2682] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:46.133762 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87132a-1090-4876-b105-ef40d74854da None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:46.143360 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87132a-1090-4876-b105-ef40d74854da None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:46.148019 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:46.148707 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.149195 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.149706 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.151067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:28:46.151625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:46.153147 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:46.163814 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:46.167594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1362/2683] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:28:46.172928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c0ca-0d23-474e-91ff-be4501b5342c None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:46.182095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073c0ca-0d23-474e-91ff-be4501b5342c None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:46.188129 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fe82-21ac-4619-8a86-926ee643d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:46.188835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fe82-21ac-4619-8a86-926ee643d22d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.189118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fe82-21ac-4619-8a86-926ee643d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.189473 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850fe82-21ac-4619-8a86-926ee643d22d admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.190183 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850fe82-21ac-4619-8a86-926ee643d22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:46.192086 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850fe82-21ac-4619-8a86-926ee643d22d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:46.202064 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:46.222920 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1322/2684] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:28:46 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:28:46.224430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:46.234880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49768ceb-0bef-49ed-b1cc-ac9ef6b2a33d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:46.289718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb08c5-545d-48b3-8f59-080920473870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:46.290378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb08c5-545d-48b3-8f59-080920473870 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.290666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb08c5-545d-48b3-8f59-080920473870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.290948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb08c5-545d-48b3-8f59-080920473870 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.291633 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb08c5-545d-48b3-8f59-080920473870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:46.293579 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb08c5-545d-48b3-8f59-080920473870 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:46.314134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1363/2685] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:28:46 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:28:46.318249 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fe82-21ac-4619-8a86-926ee643d22d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:46.328746 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850fe82-21ac-4619-8a86-926ee643d22d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:46.333314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cb2c5-b3a2-4f4e-8d07-f1ce31934d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:46.334237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cb2c5-b3a2-4f4e-8d07-f1ce31934d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.334523 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cb2c5-b3a2-4f4e-8d07-f1ce31934d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.334797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cb2c5-b3a2-4f4e-8d07-f1ce31934d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.335526 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cb2c5-b3a2-4f4e-8d07-f1ce31934d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:46.337165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cb2c5-b3a2-4f4e-8d07-f1ce31934d88 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:46.348597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1323/2686] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:28:46.352884 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb08c5-545d-48b3-8f59-080920473870 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:46.363664 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb08c5-545d-48b3-8f59-080920473870 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:46.368445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c2cdd-597b-413a-baeb-8fbc051e7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:46.369140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c2cdd-597b-413a-baeb-8fbc051e7dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.369436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c2cdd-597b-413a-baeb-8fbc051e7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.369716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c2cdd-597b-413a-baeb-8fbc051e7dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.370440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c2cdd-597b-413a-baeb-8fbc051e7dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:46.372050 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c2cdd-597b-413a-baeb-8fbc051e7dcc admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:46.382733 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1364/2687] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:28:46.386785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cb2c5-b3a2-4f4e-8d07-f1ce31934d88 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:46.397045 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cb2c5-b3a2-4f4e-8d07-f1ce31934d88 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:46.401655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:46.402568 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.402851 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.403127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] PATH_INFO: `/v3/projects/ce77c7c9f83a4f28bcbde906a9f1b614/users/9e2b5f65a4f549f48257f91b72422ad9/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.417669 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce77c7c9f83a4f28bcbde906a9f1b614, user_id=9e2b5f65a4f549f48257f91b72422ad9, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:46.420861 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:46.433845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1324/2688] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:28:46 2022] PUT /identity/v3/projects/ce77c7c9f83a4f28bcbde906a9f1b614/users/9e2b5f65a4f549f48257f91b72422ad9/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:28:46.439447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f74f-8f30-44d7-9f8f-7dd21cdd657c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.439742 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f74f-8f30-44d7-9f8f-7dd21cdd657c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.440021 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028f74f-8f30-44d7-9f8f-7dd21cdd657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.458571 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a028f74f-8f30-44d7-9f8f-7dd21cdd657c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:46.460056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a028f74f-8f30-44d7-9f8f-7dd21cdd657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:46.521807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1365/2689] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:46.533347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:46.535153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:46.595049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa851ad-3687-433d-a345-a5ba8fc3247c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:46.598734 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:46.599388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:46.599674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:46.599959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:46.610358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:46.611816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:46.621264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1325/2690] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:47.235552 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e99f-f95f-4471-bde1-c72c27be2a18 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:47.236039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e99f-f95f-4471-bde1-c72c27be2a18 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:47.236379 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e99f-f95f-4471-bde1-c72c27be2a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:47.271666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1029e99f-f95f-4471-bde1-c72c27be2a18 None None] MFA Rules not processed for user `9e2b5f65a4f549f48257f91b72422ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:47.274136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1029e99f-f95f-4471-bde1-c72c27be2a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:47.353394 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1366/2691] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:47.364955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:47.366429 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:47.431310 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4c255-7d03-4562-a99d-4ca7d86a714a service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:47.435008 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374fcbc-d640-45be-b0c0-97e78ca76bd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:47.435666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374fcbc-d640-45be-b0c0-97e78ca76bd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:47.435951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374fcbc-d640-45be-b0c0-97e78ca76bd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:47.436316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374fcbc-d640-45be-b0c0-97e78ca76bd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:47.446003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374fcbc-d640-45be-b0c0-97e78ca76bd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:47.447452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374fcbc-d640-45be-b0c0-97e78ca76bd3 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:47.456479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1326/2692] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:48.816038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4fa2-f9b8-4cdb-a5cc-d67a05c5a1f9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:48.816622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4fa2-f9b8-4cdb-a5cc-d67a05c5a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:48.816622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb4fa2-f9b8-4cdb-a5cc-d67a05c5a1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:48.835602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-27bb4fa2-f9b8-4cdb-a5cc-d67a05c5a1f9 None None] MFA Rules not processed for user `9e2b5f65a4f549f48257f91b72422ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:28:48.837065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-27bb4fa2-f9b8-4cdb-a5cc-d67a05c5a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:48.844991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1367/2693] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:28:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:28:49.108720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374fcbc-d640-45be-b0c0-97e78ca76bd3 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:49.118790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374fcbc-d640-45be-b0c0-97e78ca76bd3 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:49.122505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:49.123170 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:49.124099 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:49.124322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:49.126200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:49.136620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:49.138068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:49.146962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1327/2694] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:52.308039 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4fa2-f9b8-4cdb-a5cc-d67a05c5a1f9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:28:52.315123 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-27bb4fa2-f9b8-4cdb-a5cc-d67a05c5a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:52.322305 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:28:52.408412 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb4fa2-f9b8-4cdb-a5cc-d67a05c5a1f9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:28:52.415756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:28:52.416800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:28:52.417286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:28:52.417774 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:28:52.419720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:28:52.436831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:28:52.438798 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:28:52.452428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1368/2695] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:28:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:28:59.143123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:02.146558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:02.148037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:02.166338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f9763-6e82-4de3-b816-18f468d6bb10 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:02.171017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:02.171895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:02.172210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:02.172488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] PATH_INFO: `/v3/users/c7b17f6a722243279c86b42e8300f556` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:02.173723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b17f6a722243279c86b42e8300f556)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:02.175662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:02.230210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b17f6a722243279c86b42e8300f556'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.230916 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b17f6a722243279c86b42e8300f556'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.244974 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b17f6a722243279c86b42e8300f556'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.245711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b17f6a722243279c86b42e8300f556'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.254188 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b17f6a722243279c86b42e8300f556'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.267345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1328/2696] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:29:02 2022] DELETE /identity/v3/users/c7b17f6a722243279c86b42e8300f556 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:02.447127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=33 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:02.462966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:02.474425 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea94adb-3e20-4dd0-bec9-e54e85df26d1 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:02.553113 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:02.554170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:02.554558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:02.554841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] PATH_INFO: `/v3/projects/2c37990b166041e2a66e5136634a5274` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:02.556074 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c37990b166041e2a66e5136634a5274)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:02.558108 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:02.616337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c37990b166041e2a66e5136634a5274', 'request_id': 'req-65123305-e2b7-4ffe-8289-0387a73f7bce'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.623855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c37990b166041e2a66e5136634a5274', 'request_id': 'req-65123305-e2b7-4ffe-8289-0387a73f7bce'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.637804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c37990b166041e2a66e5136634a5274', 'request_id': 'req-65123305-e2b7-4ffe-8289-0387a73f7bce'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.650175 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] The token cache is being invalidate because project 2c37990b166041e2a66e5136634a5274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:29:02.650461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.651159 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.652806 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1369/2697] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:29:02 2022] DELETE /identity/v3/projects/2c37990b166041e2a66e5136634a5274 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:02.657653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:02.659327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:02.676937 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04266190-9f29-4438-917b-1df5e76f8f3d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:02.749708 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:02.750593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:02.750874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:02.751148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] PATH_INFO: `/v3/users/0525f558d605477fbf1bdd810683098c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:02.752876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0525f558d605477fbf1bdd810683098c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:02.754787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:02.807240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0525f558d605477fbf1bdd810683098c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.807792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0525f558d605477fbf1bdd810683098c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.821292 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0525f558d605477fbf1bdd810683098c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.822032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0525f558d605477fbf1bdd810683098c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.830101 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4dfff72e-3870-4448-9c78-ce1bfd98ef8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0525f558d605477fbf1bdd810683098c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:02.832269 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:02.845343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1329/2698] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:29:02 2022] DELETE /identity/v3/users/0525f558d605477fbf1bdd810683098c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:03.049160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.050652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:03.063882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65123305-e2b7-4ffe-8289-0387a73f7bce admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:03.150872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:03.152139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.152565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.153078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] PATH_INFO: `/v3/projects/1455010823c04e428a41ca438f0342ea` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.155466 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1455010823c04e428a41ca438f0342ea)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:03.158636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:03.219519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:03.240631 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1455010823c04e428a41ca438f0342ea', 'request_id': 'req-b3261300-b23b-44f6-893c-3de3420fe9a6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:03.247568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1455010823c04e428a41ca438f0342ea', 'request_id': 'req-b3261300-b23b-44f6-893c-3de3420fe9a6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:03.257785 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1455010823c04e428a41ca438f0342ea', 'request_id': 'req-b3261300-b23b-44f6-893c-3de3420fe9a6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:03.272144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] The token cache is being invalidate because project 1455010823c04e428a41ca438f0342ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:29:03.272436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:03.273131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b3261300-b23b-44f6-893c-3de3420fe9a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:03.274809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1370/2699] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:29:03 2022] DELETE /identity/v3/projects/1455010823c04e428a41ca438f0342ea => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:03.281476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086905ef-d5ef-4762-a494-6e0b8b8a015f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.282080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086905ef-d5ef-4762-a494-6e0b8b8a015f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.282080 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086905ef-d5ef-4762-a494-6e0b8b8a015f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.303737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-086905ef-d5ef-4762-a494-6e0b8b8a015f None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:03.305107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-086905ef-d5ef-4762-a494-6e0b8b8a015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:03.371570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1330/2700] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:03.379249 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74facd9e-8340-4bb5-856c-0d447c020a6c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.379541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74facd9e-8340-4bb5-856c-0d447c020a6c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.379821 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74facd9e-8340-4bb5-856c-0d447c020a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.400634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-74facd9e-8340-4bb5-856c-0d447c020a6c None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:03.401915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-74facd9e-8340-4bb5-856c-0d447c020a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:03.410520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1371/2701] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:29:03.415256 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086905ef-d5ef-4762-a494-6e0b8b8a015f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.425375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086905ef-d5ef-4762-a494-6e0b8b8a015f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:03.429992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:03.430673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.430962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.431240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.431990 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:29:03.432322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:03.433946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:03.445951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1331/2702] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 11:29:03.450354 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74facd9e-8340-4bb5-856c-0d447c020a6c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.460686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74facd9e-8340-4bb5-856c-0d447c020a6c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:03.466026 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9973a76-04c7-4321-a5fe-81cd64dfda2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:03.466743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9973a76-04c7-4321-a5fe-81cd64dfda2e admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.467796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9973a76-04c7-4321-a5fe-81cd64dfda2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.467921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9973a76-04c7-4321-a5fe-81cd64dfda2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.468632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9973a76-04c7-4321-a5fe-81cd64dfda2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:03.470559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9973a76-04c7-4321-a5fe-81cd64dfda2e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:03.495931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1372/2703] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:29:03 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:29:03.500297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.510938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09ca99-1afb-44e1-b014-93ae7182db0c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:03.579130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c731f49-5d70-47f2-a1a9-eab7391c39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:03.579918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c731f49-5d70-47f2-a1a9-eab7391c39b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.580237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c731f49-5d70-47f2-a1a9-eab7391c39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.580508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c731f49-5d70-47f2-a1a9-eab7391c39b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.581210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c731f49-5d70-47f2-a1a9-eab7391c39b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:03.583138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c731f49-5d70-47f2-a1a9-eab7391c39b5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:03.604200 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1332/2704] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:29:03 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:29:03.608433 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9973a76-04c7-4321-a5fe-81cd64dfda2e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.621452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9973a76-04c7-4321-a5fe-81cd64dfda2e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:03.626512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebedaf8-fc52-4c54-a4ea-a8d13d67f11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:03.627180 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebedaf8-fc52-4c54-a4ea-a8d13d67f11c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.627463 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebedaf8-fc52-4c54-a4ea-a8d13d67f11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.627754 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebedaf8-fc52-4c54-a4ea-a8d13d67f11c admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.628498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebedaf8-fc52-4c54-a4ea-a8d13d67f11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:03.630100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebedaf8-fc52-4c54-a4ea-a8d13d67f11c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:03.641268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1373/2705] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:29:03.645303 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c731f49-5d70-47f2-a1a9-eab7391c39b5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.656530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c731f49-5d70-47f2-a1a9-eab7391c39b5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:03.661192 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a65ea-832a-4358-aef7-d7c422cb714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:03.661862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a65ea-832a-4358-aef7-d7c422cb714b admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.662145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a65ea-832a-4358-aef7-d7c422cb714b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.662420 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a65ea-832a-4358-aef7-d7c422cb714b admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.663189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a65ea-832a-4358-aef7-d7c422cb714b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:03.664828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a65ea-832a-4358-aef7-d7c422cb714b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:03.675123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1333/2706] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:29:03.679332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebedaf8-fc52-4c54-a4ea-a8d13d67f11c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.689887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebedaf8-fc52-4c54-a4ea-a8d13d67f11c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:03.696561 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d18402-d90e-42e5-8158-2cfa55c94173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:03.697457 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d18402-d90e-42e5-8158-2cfa55c94173 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.697745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d18402-d90e-42e5-8158-2cfa55c94173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.698024 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d18402-d90e-42e5-8158-2cfa55c94173 admin admin] PATH_INFO: `/v3/projects/28d40b399e874553a13c51fa868d2132/users/0949ad9e009c483eb313c2f874dfe83b/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.714179 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d18402-d90e-42e5-8158-2cfa55c94173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d40b399e874553a13c51fa868d2132, user_id=0949ad9e009c483eb313c2f874dfe83b, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:03.716880 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d18402-d90e-42e5-8158-2cfa55c94173 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:03.737646 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1374/2707] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:29:03 2022] PUT /identity/v3/projects/28d40b399e874553a13c51fa868d2132/users/0949ad9e009c483eb313c2f874dfe83b/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:29:03.750251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979648f5-03df-4480-a162-8170a415cbd6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.750647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979648f5-03df-4480-a162-8170a415cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.751040 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979648f5-03df-4480-a162-8170a415cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.784601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-979648f5-03df-4480-a162-8170a415cbd6 None None] MFA Rules not processed for user `0949ad9e009c483eb313c2f874dfe83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:03.785891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-979648f5-03df-4480-a162-8170a415cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:03.835130 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:03.859140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1334/2708] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:03.863918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d18402-d90e-42e5-8158-2cfa55c94173 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.929519 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d18402-d90e-42e5-8158-2cfa55c94173 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:03.934256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78be28-7213-4fcc-b863-f2ecca5bfd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:03.934922 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78be28-7213-4fcc-b863-f2ecca5bfd78 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:03.935211 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78be28-7213-4fcc-b863-f2ecca5bfd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:03.935496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78be28-7213-4fcc-b863-f2ecca5bfd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:03.936255 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78be28-7213-4fcc-b863-f2ecca5bfd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:03.938321 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78be28-7213-4fcc-b863-f2ecca5bfd78 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:03.968052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1375/2709] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:29:03 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:29:03.971997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979648f5-03df-4480-a162-8170a415cbd6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:03.982714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979648f5-03df-4480-a162-8170a415cbd6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:04.045106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f333ef-c334-4c09-bfc4-700e0a213a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:04.046324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f333ef-c334-4c09-bfc4-700e0a213a00 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:04.046605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f333ef-c334-4c09-bfc4-700e0a213a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:04.046881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f333ef-c334-4c09-bfc4-700e0a213a00 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:04.047570 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f333ef-c334-4c09-bfc4-700e0a213a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:04.049522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f333ef-c334-4c09-bfc4-700e0a213a00 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:04.069879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1335/2710] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:29:03 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:29:04.074222 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78be28-7213-4fcc-b863-f2ecca5bfd78 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:04.086167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78be28-7213-4fcc-b863-f2ecca5bfd78 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:04.091092 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992fbfc-e853-484d-8ec4-18df5c6c5dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:04.091765 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992fbfc-e853-484d-8ec4-18df5c6c5dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:04.092719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992fbfc-e853-484d-8ec4-18df5c6c5dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:04.093007 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992fbfc-e853-484d-8ec4-18df5c6c5dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:04.093734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992fbfc-e853-484d-8ec4-18df5c6c5dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:04.095370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992fbfc-e853-484d-8ec4-18df5c6c5dd1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:04.106805 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1376/2711] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:29:04.111327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f333ef-c334-4c09-bfc4-700e0a213a00 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:04.121508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f333ef-c334-4c09-bfc4-700e0a213a00 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:04.126058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7640289-00bd-446c-b0da-e2ca95106d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:04.126931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7640289-00bd-446c-b0da-e2ca95106d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:04.127208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7640289-00bd-446c-b0da-e2ca95106d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:04.127479 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7640289-00bd-446c-b0da-e2ca95106d0f admin admin] PATH_INFO: `/v3/projects/ab8fde7f90c544a38d7e8ef3251647d6/users/24c770d0fdf3405b9d060c8b1e8ed2c5/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:04.145007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7640289-00bd-446c-b0da-e2ca95106d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8fde7f90c544a38d7e8ef3251647d6, user_id=24c770d0fdf3405b9d060c8b1e8ed2c5, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:04.147678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7640289-00bd-446c-b0da-e2ca95106d0f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:04.162055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1336/2712] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:29:04 2022] PUT /identity/v3/projects/ab8fde7f90c544a38d7e8ef3251647d6/users/24c770d0fdf3405b9d060c8b1e8ed2c5/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:29:04.166192 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992fbfc-e853-484d-8ec4-18df5c6c5dd1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:04.177541 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992fbfc-e853-484d-8ec4-18df5c6c5dd1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:04.206493 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:04.238345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e5406-688d-4f45-a8e4-3b9af980cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:04.239243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5406-688d-4f45-a8e4-3b9af980cc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:04.239355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5406-688d-4f45-a8e4-3b9af980cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:04.239685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e5406-688d-4f45-a8e4-3b9af980cc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:04.240523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e5406-688d-4f45-a8e4-3b9af980cc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:04.242166 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e5406-688d-4f45-a8e4-3b9af980cc98 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:04.253783 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1377/2713] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:29:04.257877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7640289-00bd-446c-b0da-e2ca95106d0f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:04.268338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7640289-00bd-446c-b0da-e2ca95106d0f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:04.272992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:04.273866 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:04.274145 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:04.274423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] PATH_INFO: `/v3/projects/ab8fde7f90c544a38d7e8ef3251647d6/users/24c770d0fdf3405b9d060c8b1e8ed2c5/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:04.276579 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8fde7f90c544a38d7e8ef3251647d6, user_id=24c770d0fdf3405b9d060c8b1e8ed2c5, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:04.279120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:04.290326 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1337/2714] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:29:04 2022] PUT /identity/v3/projects/ab8fde7f90c544a38d7e8ef3251647d6/users/24c770d0fdf3405b9d060c8b1e8ed2c5/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:04.301219 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a99ea0-bc38-455c-9656-df3c7cae051d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:04.301535 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a99ea0-bc38-455c-9656-df3c7cae051d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:04.301813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a99ea0-bc38-455c-9656-df3c7cae051d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:04.330268 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-55a99ea0-bc38-455c-9656-df3c7cae051d None None] MFA Rules not processed for user `24c770d0fdf3405b9d060c8b1e8ed2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:04.331509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-55a99ea0-bc38-455c-9656-df3c7cae051d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:04.399563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1378/2715] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:04.410365 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:04.412058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:04.470155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d65e30-d62b-4f20-9cea-e61b5cc31aad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:04.473849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1314c2-97a5-4c9d-8cb6-a1dd0add6713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:04.474498 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1314c2-97a5-4c9d-8cb6-a1dd0add6713 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:04.474782 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1314c2-97a5-4c9d-8cb6-a1dd0add6713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:04.475061 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1314c2-97a5-4c9d-8cb6-a1dd0add6713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:04.530664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:04.535721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1314c2-97a5-4c9d-8cb6-a1dd0add6713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:04.538055 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1314c2-97a5-4c9d-8cb6-a1dd0add6713 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:04.549427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1338/2716] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:07.075265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a99ea0-bc38-455c-9656-df3c7cae051d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:07.140773 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a99ea0-bc38-455c-9656-df3c7cae051d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:07.145312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:07.146194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:07.146477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:07.146755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] PATH_INFO: `/v3/users/0949ad9e009c483eb313c2f874dfe83b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:07.149401 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0949ad9e009c483eb313c2f874dfe83b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:07.151348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:07.199563 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0949ad9e009c483eb313c2f874dfe83b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.200240 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0949ad9e009c483eb313c2f874dfe83b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.205526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:07.207638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0949ad9e009c483eb313c2f874dfe83b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.217611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0949ad9e009c483eb313c2f874dfe83b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.218300 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0949ad9e009c483eb313c2f874dfe83b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.236951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1379/2717] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:29:07 2022] DELETE /identity/v3/users/0949ad9e009c483eb313c2f874dfe83b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:07.241515 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a213f-c480-4e2d-99f1-4eeb1f9abf05 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:07.242041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a213f-c480-4e2d-99f1-4eeb1f9abf05 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:07.242165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a213f-c480-4e2d-99f1-4eeb1f9abf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:07.263270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-820a213f-c480-4e2d-99f1-4eeb1f9abf05 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:07.265471 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-820a213f-c480-4e2d-99f1-4eeb1f9abf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:07.349608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1339/2718] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:07.359819 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:07.361278 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:07.426334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cec01e-b5f3-42a3-b15a-bc87f9442762 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:07.430011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27648aff-df77-40f4-867f-20dae3dd2ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:07.430671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27648aff-df77-40f4-867f-20dae3dd2ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:07.430958 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27648aff-df77-40f4-867f-20dae3dd2ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:07.431238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27648aff-df77-40f4-867f-20dae3dd2ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:07.441389 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27648aff-df77-40f4-867f-20dae3dd2ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:07.442828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27648aff-df77-40f4-867f-20dae3dd2ad7 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:07.452940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1380/2719] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:29:07.798110 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a213f-c480-4e2d-99f1-4eeb1f9abf05 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:07.799792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-820a213f-c480-4e2d-99f1-4eeb1f9abf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:07.818436 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a213f-c480-4e2d-99f1-4eeb1f9abf05 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:07.823195 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:07.824077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:07.824409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:07.824688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] PATH_INFO: `/v3/projects/28d40b399e874553a13c51fa868d2132` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:07.825957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d40b399e874553a13c51fa868d2132)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:07.828721 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:07.881907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d40b399e874553a13c51fa868d2132', 'request_id': 'req-5ee7a897-0958-46c9-bb65-d6475242b6c4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.887727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d40b399e874553a13c51fa868d2132', 'request_id': 'req-5ee7a897-0958-46c9-bb65-d6475242b6c4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.897354 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d40b399e874553a13c51fa868d2132', 'request_id': 'req-5ee7a897-0958-46c9-bb65-d6475242b6c4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.909425 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] The token cache is being invalidate because project 28d40b399e874553a13c51fa868d2132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:29:07.909741 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.910377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:07.911925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1340/2720] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:29:07 2022] DELETE /identity/v3/projects/28d40b399e874553a13c51fa868d2132 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:07.916873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27648aff-df77-40f4-867f-20dae3dd2ad7 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:07.927139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27648aff-df77-40f4-867f-20dae3dd2ad7 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:07.996686 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:07.997574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:07.997854 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:07.998131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] PATH_INFO: `/v3/users/24c770d0fdf3405b9d060c8b1e8ed2c5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:07.999375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c770d0fdf3405b9d060c8b1e8ed2c5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:08.001973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:08.049852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c770d0fdf3405b9d060c8b1e8ed2c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.050625 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c770d0fdf3405b9d060c8b1e8ed2c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.058421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c770d0fdf3405b9d060c8b1e8ed2c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.066979 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c770d0fdf3405b9d060c8b1e8ed2c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.067752 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-42f477f0-122c-4040-a5ea-8e6c1a7e20a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c770d0fdf3405b9d060c8b1e8ed2c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.080261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:08.091095 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1381/2721] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:29:07 2022] DELETE /identity/v3/users/24c770d0fdf3405b9d060c8b1e8ed2c5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:08.403951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:08.405478 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:08.419780 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7a897-0958-46c9-bb65-d6475242b6c4 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:08.482888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:08.483751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:08.484032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:08.484334 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] PATH_INFO: `/v3/projects/ab8fde7f90c544a38d7e8ef3251647d6` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:08.485518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8fde7f90c544a38d7e8ef3251647d6)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:08.487714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:08.508874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:08.543034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8fde7f90c544a38d7e8ef3251647d6', 'request_id': 'req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.548463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8fde7f90c544a38d7e8ef3251647d6', 'request_id': 'req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.555947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8fde7f90c544a38d7e8ef3251647d6', 'request_id': 'req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.570855 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] The token cache is being invalidate because project ab8fde7f90c544a38d7e8ef3251647d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:29:08.571142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.571793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-9fecd8d2-2b60-480c-b25e-a45a3bf13f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:08.573517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1341/2722] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:29:08 2022] DELETE /identity/v3/projects/ab8fde7f90c544a38d7e8ef3251647d6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:08.578924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bcb0b-1a95-4a5c-ba3e-a846c2afbcb7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:08.579213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bcb0b-1a95-4a5c-ba3e-a846c2afbcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:08.579487 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bcb0b-1a95-4a5c-ba3e-a846c2afbcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:08.599939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9c2bcb0b-1a95-4a5c-ba3e-a846c2afbcb7 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:08.601863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9c2bcb0b-1a95-4a5c-ba3e-a846c2afbcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:08.666630 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1382/2723] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:08.675980 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a75d-034d-4976-a7b9-36cf0bcb7cdc None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:08.676304 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a75d-034d-4976-a7b9-36cf0bcb7cdc None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:08.676660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4a75d-034d-4976-a7b9-36cf0bcb7cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:08.697649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-efc4a75d-034d-4976-a7b9-36cf0bcb7cdc None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:08.698879 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-efc4a75d-034d-4976-a7b9-36cf0bcb7cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:08.706764 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1342/2724] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:08.711333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bcb0b-1a95-4a5c-ba3e-a846c2afbcb7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:08.720954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bcb0b-1a95-4a5c-ba3e-a846c2afbcb7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:08.725860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:08.726526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:08.726813 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:08.727088 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:08.727838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:29:08.728176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:08.729807 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:08.742330 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1383/2725] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:29:08.746718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4a75d-034d-4976-a7b9-36cf0bcb7cdc None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:08.756758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4a75d-034d-4976-a7b9-36cf0bcb7cdc None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:08.761717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af8c66-86fb-46cf-a266-388e1c41303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:08.762841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af8c66-86fb-46cf-a266-388e1c41303d admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:08.762841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af8c66-86fb-46cf-a266-388e1c41303d admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:08.763082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af8c66-86fb-46cf-a266-388e1c41303d admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:08.763622 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af8c66-86fb-46cf-a266-388e1c41303d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:08.765567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af8c66-86fb-46cf-a266-388e1c41303d admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:08.791880 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1343/2726] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:29:08 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:29:08.798713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:08.809939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d06d7-be0f-46a8-a4c2-fd3f7f39ed49 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:08.871131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc65d-1e58-46d0-b69e-1269fbac345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:08.871811 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc65d-1e58-46d0-b69e-1269fbac345a admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:08.872097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc65d-1e58-46d0-b69e-1269fbac345a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:08.872407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dc65d-1e58-46d0-b69e-1269fbac345a admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:08.873107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dc65d-1e58-46d0-b69e-1269fbac345a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:08.875655 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dc65d-1e58-46d0-b69e-1269fbac345a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:08.898826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1384/2727] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:29:08 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:29:08.902954 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af8c66-86fb-46cf-a266-388e1c41303d admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:08.913607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af8c66-86fb-46cf-a266-388e1c41303d admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:08.918447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b04327-388a-4145-ad05-5d840650f772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:08.919133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b04327-388a-4145-ad05-5d840650f772 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:08.919485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b04327-388a-4145-ad05-5d840650f772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:08.919840 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b04327-388a-4145-ad05-5d840650f772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:08.921485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b04327-388a-4145-ad05-5d840650f772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:08.923489 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b04327-388a-4145-ad05-5d840650f772 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:08.942000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1344/2728] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:29:08.943620 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc65d-1e58-46d0-b69e-1269fbac345a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:08.953913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dc65d-1e58-46d0-b69e-1269fbac345a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:08.961661 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed669fc-24fd-4be4-b648-7ec086e7e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:08.962993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed669fc-24fd-4be4-b648-7ec086e7e4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:08.963498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed669fc-24fd-4be4-b648-7ec086e7e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:08.963990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed669fc-24fd-4be4-b648-7ec086e7e4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:08.965365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed669fc-24fd-4be4-b648-7ec086e7e4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:08.967992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed669fc-24fd-4be4-b648-7ec086e7e4dd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:08.979809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1385/2729] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:29:08.984718 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b04327-388a-4145-ad05-5d840650f772 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:08.995165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b04327-388a-4145-ad05-5d840650f772 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:09.001308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:09.002187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:09.002470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:09.002745 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] PATH_INFO: `/v3/projects/b459390152e6429a81a23579e30e1f3f/users/4a90bd266240462ca09e998ecd7157af/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:09.021944 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b459390152e6429a81a23579e30e1f3f, user_id=4a90bd266240462ca09e998ecd7157af, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:09.024661 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:09.039602 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1345/2730] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:29:08 2022] PUT /identity/v3/projects/b459390152e6429a81a23579e30e1f3f/users/4a90bd266240462ca09e998ecd7157af/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:09.050820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1d23-157a-4ac7-9144-825718940ff8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:09.051104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1d23-157a-4ac7-9144-825718940ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:09.051403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1d23-157a-4ac7-9144-825718940ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:09.080734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0dfc1d23-157a-4ac7-9144-825718940ff8 None None] MFA Rules not processed for user `4a90bd266240462ca09e998ecd7157af`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:09.081980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0dfc1d23-157a-4ac7-9144-825718940ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:09.133967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:09.154526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1386/2731] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:29:09.168278 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:09.170063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:09.232804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44961-8179-45aa-8a04-56b05da5c616 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:09.237555 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f030fe1-ff75-4bb0-a20d-e6a767d22df1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:09.238332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030fe1-ff75-4bb0-a20d-e6a767d22df1 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:09.238618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030fe1-ff75-4bb0-a20d-e6a767d22df1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:09.238894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030fe1-ff75-4bb0-a20d-e6a767d22df1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:09.248082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f030fe1-ff75-4bb0-a20d-e6a767d22df1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:09.250287 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f030fe1-ff75-4bb0-a20d-e6a767d22df1 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:09.260703 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1346/2732] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:12.279998 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc1d23-157a-4ac7-9144-825718940ff8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:12.343462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc1d23-157a-4ac7-9144-825718940ff8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:12.347889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:12.348791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:12.349073 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:12.349346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] PATH_INFO: `/v3/users/4a90bd266240462ca09e998ecd7157af` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:12.350677 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a90bd266240462ca09e998ecd7157af)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:12.353002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:12.403458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a90bd266240462ca09e998ecd7157af'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:12.404127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a90bd266240462ca09e998ecd7157af'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:12.411014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a90bd266240462ca09e998ecd7157af'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:12.418237 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a90bd266240462ca09e998ecd7157af'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:12.418878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a90bd266240462ca09e998ecd7157af'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:12.436889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1387/2733] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:29:12 2022] DELETE /identity/v3/users/4a90bd266240462ca09e998ecd7157af => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:12.441397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738f0e-d961-48cb-b1d7-4ecb84052cb1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:12.441891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738f0e-d961-48cb-b1d7-4ecb84052cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:12.441998 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738f0e-d961-48cb-b1d7-4ecb84052cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:12.458506 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-06738f0e-d961-48cb-b1d7-4ecb84052cb1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:12.460017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06738f0e-d961-48cb-b1d7-4ecb84052cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:12.511934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:12.535610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1347/2734] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:12.545438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:12.546973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:12.608787 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae4f4b-4946-4c39-884d-fbae8f4f048d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:12.612375 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aaa7b8-aece-4fd3-854e-6c39cc98fbc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:12.613033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa7b8-aece-4fd3-854e-6c39cc98fbc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:12.613316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa7b8-aece-4fd3-854e-6c39cc98fbc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:12.613591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aaa7b8-aece-4fd3-854e-6c39cc98fbc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:12.622783 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaa7b8-aece-4fd3-854e-6c39cc98fbc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:12.625176 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aaa7b8-aece-4fd3-854e-6c39cc98fbc9 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:12.634104 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1388/2735] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:12.904229 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06738f0e-d961-48cb-b1d7-4ecb84052cb1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:12.905816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-06738f0e-d961-48cb-b1d7-4ecb84052cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:12.918408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06738f0e-d961-48cb-b1d7-4ecb84052cb1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:12.923246 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:12.924219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:12.924563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:12.925540 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] PATH_INFO: `/v3/projects/b459390152e6429a81a23579e30e1f3f` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:12.926817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b459390152e6429a81a23579e30e1f3f)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:12.928778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:12.977785 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b459390152e6429a81a23579e30e1f3f', 'request_id': 'req-e725a112-0704-4d02-a052-7683723c42f9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:12.983150 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b459390152e6429a81a23579e30e1f3f', 'request_id': 'req-e725a112-0704-4d02-a052-7683723c42f9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:12.990578 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b459390152e6429a81a23579e30e1f3f', 'request_id': 'req-e725a112-0704-4d02-a052-7683723c42f9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:13.002185 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] The token cache is being invalidate because project b459390152e6429a81a23579e30e1f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:29:13.002468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:13.003093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:29:13.004655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1348/2736] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:29:12 2022] DELETE /identity/v3/projects/b459390152e6429a81a23579e30e1f3f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:29:20.595905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4078-c9f7-4a7f-a866-7ba0493674a9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:20.596475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4078-c9f7-4a7f-a866-7ba0493674a9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:20.596475 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c4078-c9f7-4a7f-a866-7ba0493674a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:20.617089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e45c4078-c9f7-4a7f-a866-7ba0493674a9 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:20.618313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e45c4078-c9f7-4a7f-a866-7ba0493674a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:20.624279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:20.686612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1389/2737] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:20.702267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:20.704039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:20.785704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725a112-0704-4d02-a052-7683723c42f9 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:20.791095 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:20.791747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:20.792026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:20.792329 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:20.801182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:20.803335 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:20.813066 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1349/2738] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:23.636683 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a5c9-f071-4179-a4d6-fc7f98034e92 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:23.637231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a5c9-f071-4179-a4d6-fc7f98034e92 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:23.637231 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a5c9-f071-4179-a4d6-fc7f98034e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:23.655428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a534a5c9-f071-4179-a4d6-fc7f98034e92 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:23.656727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a534a5c9-f071-4179-a4d6-fc7f98034e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:23.665260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1390/2739] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:23.679907 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:23.681443 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:23.696366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184721b-7229-430d-b4aa-01048b568fb0 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:23.701843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1ad89-d447-4dd0-b3a9-ac65a473d972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:23.702484 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ad89-d447-4dd0-b3a9-ac65a473d972 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:23.702771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ad89-d447-4dd0-b3a9-ac65a473d972 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:23.703049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ad89-d447-4dd0-b3a9-ac65a473d972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:23.712081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1ad89-d447-4dd0-b3a9-ac65a473d972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:23.713679 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1ad89-d447-4dd0-b3a9-ac65a473d972 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:23.723567 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1350/2740] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:26.866803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb363755-db7e-4886-a844-d6aa844f9441 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:26.867452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb363755-db7e-4886-a844-d6aa844f9441 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:26.867452 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb363755-db7e-4886-a844-d6aa844f9441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:26.885365 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-eb363755-db7e-4886-a844-d6aa844f9441 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:26.886574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-eb363755-db7e-4886-a844-d6aa844f9441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:26.894353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1391/2741] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:26.908239 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1ad89-d447-4dd0-b3a9-ac65a473d972 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:26.919407 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1ad89-d447-4dd0-b3a9-ac65a473d972 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:26.925550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e7fd5-f26c-4b49-958d-d6f5d377e42d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:26.926182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7fd5-f26c-4b49-958d-d6f5d377e42d service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:26.926465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7fd5-f26c-4b49-958d-d6f5d377e42d service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:26.926738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e7fd5-f26c-4b49-958d-d6f5d377e42d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:26.935019 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e7fd5-f26c-4b49-958d-d6f5d377e42d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:26.936638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e7fd5-f26c-4b49-958d-d6f5d377e42d service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:26.946094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1351/2742] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:29.948265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307b18f-12b9-40ab-a42e-4f765c69bb4a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:29.948823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307b18f-12b9-40ab-a42e-4f765c69bb4a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:29.948980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307b18f-12b9-40ab-a42e-4f765c69bb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:29.968803 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5307b18f-12b9-40ab-a42e-4f765c69bb4a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:29.970030 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5307b18f-12b9-40ab-a42e-4f765c69bb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:29.978545 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1392/2743] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:29:29.993931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e7fd5-f26c-4b49-958d-d6f5d377e42d service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:30.005050 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e7fd5-f26c-4b49-958d-d6f5d377e42d service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:30.010456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c592d-c694-4387-b421-d89c433a8407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:30.011088 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c592d-c694-4387-b421-d89c433a8407 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:30.011370 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c592d-c694-4387-b421-d89c433a8407 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:30.011644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c592d-c694-4387-b421-d89c433a8407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:30.019590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c592d-c694-4387-b421-d89c433a8407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:30.021181 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c592d-c694-4387-b421-d89c433a8407 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:30.030464 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1352/2744] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:34.136132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246701a9-c31c-4e69-afaf-f7b519ff5fda None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:34.136709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246701a9-c31c-4e69-afaf-f7b519ff5fda None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:34.136709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246701a9-c31c-4e69-afaf-f7b519ff5fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:34.155964 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-246701a9-c31c-4e69-afaf-f7b519ff5fda None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:34.157230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-246701a9-c31c-4e69-afaf-f7b519ff5fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:34.165264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1393/2745] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:34.181213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c592d-c694-4387-b421-d89c433a8407 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:34.193959 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c592d-c694-4387-b421-d89c433a8407 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:34.199629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78241622-66b9-4332-a4a6-2ac9d7fdb3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:34.200333 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241622-66b9-4332-a4a6-2ac9d7fdb3ff service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:34.200620 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241622-66b9-4332-a4a6-2ac9d7fdb3ff service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:34.200897 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78241622-66b9-4332-a4a6-2ac9d7fdb3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:34.209353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78241622-66b9-4332-a4a6-2ac9d7fdb3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:34.211194 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78241622-66b9-4332-a4a6-2ac9d7fdb3ff service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:34.221647 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1353/2746] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:38.325396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0dce7-0aea-469d-8a9a-2af826c82b29 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:38.325889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0dce7-0aea-469d-8a9a-2af826c82b29 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:38.326004 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0dce7-0aea-469d-8a9a-2af826c82b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:38.346244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-01d0dce7-0aea-469d-8a9a-2af826c82b29 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:38.347470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-01d0dce7-0aea-469d-8a9a-2af826c82b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:38.355850 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1394/2747] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:29:38.376510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78241622-66b9-4332-a4a6-2ac9d7fdb3ff service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:29:38.383475 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:38.392798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78241622-66b9-4332-a4a6-2ac9d7fdb3ff service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:29:38.399830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e1dc6-1721-4772-84ee-6ea4c17d6cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:29:38.400530 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1dc6-1721-4772-84ee-6ea4c17d6cf4 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:38.400819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1dc6-1721-4772-84ee-6ea4c17d6cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:38.401098 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e1dc6-1721-4772-84ee-6ea4c17d6cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:38.410400 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e1dc6-1721-4772-84ee-6ea4c17d6cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:29:38.412087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e1dc6-1721-4772-84ee-6ea4c17d6cf4 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:29:38.423438 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1354/2748] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:29:48.340727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=37 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:48.418265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:29:53.383802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66a0b7-913c-4619-be78-3b18c8121e49 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:29:53.384391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66a0b7-913c-4619-be78-3b18c8121e49 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:29:53.384391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66a0b7-913c-4619-be78-3b18c8121e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:29:53.402218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4f66a0b7-913c-4619-be78-3b18c8121e49 None None] MFA Rules not processed for user `9e2b5f65a4f549f48257f91b72422ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:29:53.403450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4f66a0b7-913c-4619-be78-3b18c8121e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:29:53.463838 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1395/2749] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:29:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:03.453471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=25 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:06.431751 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46386-d468-4e7c-bed0-2810376ffa98 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:06.432414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46386-d468-4e7c-bed0-2810376ffa98 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:06.432414 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b46386-d468-4e7c-bed0-2810376ffa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:06.450696 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e4b46386-d468-4e7c-bed0-2810376ffa98 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:06.451908 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e4b46386-d468-4e7c-bed0-2810376ffa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:06.459759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1355/2750] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:06.483458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66a0b7-913c-4619-be78-3b18c8121e49 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:06.496089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66a0b7-913c-4619-be78-3b18c8121e49 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:06.501529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88230d3d-4ee3-44ef-b378-ab2c2875952b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:06.502171 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230d3d-4ee3-44ef-b378-ab2c2875952b service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:06.502456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230d3d-4ee3-44ef-b378-ab2c2875952b service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:06.502734 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230d3d-4ee3-44ef-b378-ab2c2875952b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:06.511532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88230d3d-4ee3-44ef-b378-ab2c2875952b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:06.513144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88230d3d-4ee3-44ef-b378-ab2c2875952b service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:06.522915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1396/2751] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:30:09.683187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0391c-0ee0-49e0-8034-86d7b6da04e2 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:09.683756 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0391c-0ee0-49e0-8034-86d7b6da04e2 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:09.683895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0391c-0ee0-49e0-8034-86d7b6da04e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:09.702308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-59b0391c-0ee0-49e0-8034-86d7b6da04e2 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:09.703499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-59b0391c-0ee0-49e0-8034-86d7b6da04e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:09.711558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1356/2752] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:09.726502 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88230d3d-4ee3-44ef-b378-ab2c2875952b service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:09.738574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88230d3d-4ee3-44ef-b378-ab2c2875952b service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:09.744020 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dbc41-0ab9-46f4-841c-37bc90fbdfc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:09.744744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbc41-0ab9-46f4-841c-37bc90fbdfc1 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:09.745639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbc41-0ab9-46f4-841c-37bc90fbdfc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:09.745939 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dbc41-0ab9-46f4-841c-37bc90fbdfc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:09.754525 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dbc41-0ab9-46f4-841c-37bc90fbdfc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:09.756168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dbc41-0ab9-46f4-841c-37bc90fbdfc1 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:09.765961 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1397/2753] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:30:12.775830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142381ee-2419-41d2-b3b3-edb8349a18c6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:12.776352 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142381ee-2419-41d2-b3b3-edb8349a18c6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:12.776487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142381ee-2419-41d2-b3b3-edb8349a18c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:12.795171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-142381ee-2419-41d2-b3b3-edb8349a18c6 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:12.796338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-142381ee-2419-41d2-b3b3-edb8349a18c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:12.803992 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1357/2754] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:12.818687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dbc41-0ab9-46f4-841c-37bc90fbdfc1 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:12.829747 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dbc41-0ab9-46f4-841c-37bc90fbdfc1 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:12.835634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6f1b2-3fc0-41c8-b0c6-d1aad38d1cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:12.836316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f1b2-3fc0-41c8-b0c6-d1aad38d1cbe service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:12.836604 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f1b2-3fc0-41c8-b0c6-d1aad38d1cbe service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:12.836890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f1b2-3fc0-41c8-b0c6-d1aad38d1cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:12.845702 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6f1b2-3fc0-41c8-b0c6-d1aad38d1cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:12.847284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6f1b2-3fc0-41c8-b0c6-d1aad38d1cbe service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:12.857213 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1398/2755] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:30:15.937699 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b598e-4749-4165-9679-68a1e17bfec9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:15.938242 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b598e-4749-4165-9679-68a1e17bfec9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:15.938353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b598e-4749-4165-9679-68a1e17bfec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:15.956403 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3f7b598e-4749-4165-9679-68a1e17bfec9 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:15.957601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3f7b598e-4749-4165-9679-68a1e17bfec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:15.965643 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1358/2756] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:15.981051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6f1b2-3fc0-41c8-b0c6-d1aad38d1cbe service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:15.992291 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6f1b2-3fc0-41c8-b0c6-d1aad38d1cbe service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:15.997736 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8becab-4ca6-4db5-9536-3c994c05e9fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:15.999296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8becab-4ca6-4db5-9536-3c994c05e9fd service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:15.999296 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8becab-4ca6-4db5-9536-3c994c05e9fd service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:15.999532 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8becab-4ca6-4db5-9536-3c994c05e9fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:16.007508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8becab-4ca6-4db5-9536-3c994c05e9fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:16.009114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8becab-4ca6-4db5-9536-3c994c05e9fd service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:16.019320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1399/2757] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:30:20.115522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f045-b3b9-4669-be1e-314119288d2a None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:20.116068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f045-b3b9-4669-be1e-314119288d2a None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:20.116193 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f045-b3b9-4669-be1e-314119288d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:20.133550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4588f045-b3b9-4669-be1e-314119288d2a None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:20.134738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4588f045-b3b9-4669-be1e-314119288d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:20.143214 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1359/2758] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Jul 14 11:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:20.159547 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8becab-4ca6-4db5-9536-3c994c05e9fd service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:20.170852 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8becab-4ca6-4db5-9536-3c994c05e9fd service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:20.176369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716ec7-e8df-42ee-8e3b-210f3b44087f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:20.177029 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716ec7-e8df-42ee-8e3b-210f3b44087f service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:20.177312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716ec7-e8df-42ee-8e3b-210f3b44087f service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:20.177585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78716ec7-e8df-42ee-8e3b-210f3b44087f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:20.186326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78716ec7-e8df-42ee-8e3b-210f3b44087f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:20.187959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78716ec7-e8df-42ee-8e3b-210f3b44087f service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:20.197458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1400/2759] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:30:28.148301 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67cf46-003d-4d24-ad40-f033f3f29fe9 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:28.148791 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67cf46-003d-4d24-ad40-f033f3f29fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:28.148895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67cf46-003d-4d24-ad40-f033f3f29fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:28.172151 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-cd67cf46-003d-4d24-ad40-f033f3f29fe9 None None] MFA Rules not processed for user `f1ad883ea911405c847e8f166a6dfe4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:28.173416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cd67cf46-003d-4d24-ad40-f033f3f29fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:28.230026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1360/2760] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:30:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:30.193313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=30 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:32.116488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716ec7-e8df-42ee-8e3b-210f3b44087f service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:32.127735 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78716ec7-e8df-42ee-8e3b-210f3b44087f service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:32.133168 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:32.133801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:32.134078 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:32.134357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:32.136137 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:32.146790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:32.148434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:32.158546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1401/2761] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:30:38.222845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=40 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:39.611546 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67cf46-003d-4d24-ad40-f033f3f29fe9 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:39.624934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67cf46-003d-4d24-ad40-f033f3f29fe9 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:39.630601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:39.631323 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:39.631678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:39.632025 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:39.633856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:39.646259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:39.647848 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:39.659224 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1361/2762] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:30:42.153687 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:49.654053 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:52.899831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:52.901266 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:52.967615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:52.969156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:52.975167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0cdd7-4e1c-4b38-b4a0-a64de36021f8 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:52.980332 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:52.980997 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:52.981284 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:52.984913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:52.986627 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f83260-cbac-4799-902b-49d9e542f7a4 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:52.986877 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:52.991429 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:52.992430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:52.992804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:52.993142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] PATH_INFO: `/v3/users/9e2b5f65a4f549f48257f91b72422ad9` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:52.994395 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2b5f65a4f549f48257f91b72422ad9)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:52.996409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:52.998932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:53.000591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:53.010730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1402/2763] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:30:53.046730 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2b5f65a4f549f48257f91b72422ad9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.047381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2b5f65a4f549f48257f91b72422ad9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.059248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2b5f65a4f549f48257f91b72422ad9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.059878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2b5f65a4f549f48257f91b72422ad9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.067951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-d653faa7-db44-45c0-a9d4-677781d032cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2b5f65a4f549f48257f91b72422ad9'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.080465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1362/2764] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:30:52 2022] DELETE /identity/v3/users/9e2b5f65a4f549f48257f91b72422ad9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:30:53.261533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:53.276720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eed462-5dc6-4403-a064-9b4dfe9d4250 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:53.333894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:53.334768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.335069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.335342 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] PATH_INFO: `/v3/projects/ce77c7c9f83a4f28bcbde906a9f1b614` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.336919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce77c7c9f83a4f28bcbde906a9f1b614)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:53.338868 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:53.385311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce77c7c9f83a4f28bcbde906a9f1b614', 'request_id': 'req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.391345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce77c7c9f83a4f28bcbde906a9f1b614', 'request_id': 'req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.399142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce77c7c9f83a4f28bcbde906a9f1b614', 'request_id': 'req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.409873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] The token cache is being invalidate because project ce77c7c9f83a4f28bcbde906a9f1b614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:30:53.410191 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.410879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f12e8fe-b0e3-4aaf-9114-188cc8010f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:30:53.412439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1403/2765] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:30:53 2022] DELETE /identity/v3/projects/ce77c7c9f83a4f28bcbde906a9f1b614 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:30:53.417508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136501-acd4-4bd4-81cf-58022d93007d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.417792 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136501-acd4-4bd4-81cf-58022d93007d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.418068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51136501-acd4-4bd4-81cf-58022d93007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.436750 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-51136501-acd4-4bd4-81cf-58022d93007d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:53.437950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-51136501-acd4-4bd4-81cf-58022d93007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:53.500176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1363/2766] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:53.508894 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d31a-fe10-4b3f-b6f7-19a0b29749c1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.509151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d31a-fe10-4b3f-b6f7-19a0b29749c1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.509472 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d31a-fe10-4b3f-b6f7-19a0b29749c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.529764 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-15c8d31a-fe10-4b3f-b6f7-19a0b29749c1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:53.530973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-15c8d31a-fe10-4b3f-b6f7-19a0b29749c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:53.538912 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1404/2767] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:53.543120 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51136501-acd4-4bd4-81cf-58022d93007d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:53.553427 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51136501-acd4-4bd4-81cf-58022d93007d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:53.557995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:53.558648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.558934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.559208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.559934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:30:53.560280 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:53.561887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:53.576085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1364/2768] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:30:53.580385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d31a-fe10-4b3f-b6f7-19a0b29749c1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:53.590029 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d31a-fe10-4b3f-b6f7-19a0b29749c1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:53.594639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adab747-ba38-400b-9ef6-f08253e96c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:53.595318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab747-ba38-400b-9ef6-f08253e96c7c admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.595598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab747-ba38-400b-9ef6-f08253e96c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.595871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adab747-ba38-400b-9ef6-f08253e96c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.596627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adab747-ba38-400b-9ef6-f08253e96c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:53.598522 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adab747-ba38-400b-9ef6-f08253e96c7c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:53.608367 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:53.625881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1405/2769] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:30:53 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:30:53.630668 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:53.641137 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd24713-a294-44dc-9f28-ad4d10768394 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:53.698020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf49949-9c91-4aaf-abb4-3f5c2a169e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:53.698692 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf49949-9c91-4aaf-abb4-3f5c2a169e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.698977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf49949-9c91-4aaf-abb4-3f5c2a169e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.699257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf49949-9c91-4aaf-abb4-3f5c2a169e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.699940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf49949-9c91-4aaf-abb4-3f5c2a169e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:53.701877 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf49949-9c91-4aaf-abb4-3f5c2a169e25 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:53.708408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:53.724222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1365/2770] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:30:53 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:30:53.728285 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adab747-ba38-400b-9ef6-f08253e96c7c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:53.738893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adab747-ba38-400b-9ef6-f08253e96c7c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:53.743357 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e303c7-aa6d-4f13-bed7-63fb3d19d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:53.744005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e303c7-aa6d-4f13-bed7-63fb3d19d36e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.744320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e303c7-aa6d-4f13-bed7-63fb3d19d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.744595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e303c7-aa6d-4f13-bed7-63fb3d19d36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.745315 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e303c7-aa6d-4f13-bed7-63fb3d19d36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:53.746966 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e303c7-aa6d-4f13-bed7-63fb3d19d36e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:53.757948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1406/2771] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:30:53.762261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf49949-9c91-4aaf-abb4-3f5c2a169e25 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:53.772843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf49949-9c91-4aaf-abb4-3f5c2a169e25 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:53.778623 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9029a-f7eb-46ce-80a6-8f6caa81b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:53.779315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9029a-f7eb-46ce-80a6-8f6caa81b130 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.779600 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9029a-f7eb-46ce-80a6-8f6caa81b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.779871 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9029a-f7eb-46ce-80a6-8f6caa81b130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.780639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9029a-f7eb-46ce-80a6-8f6caa81b130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:53.782248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9029a-f7eb-46ce-80a6-8f6caa81b130 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:53.794483 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1366/2772] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:30:53.798634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e303c7-aa6d-4f13-bed7-63fb3d19d36e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:53.809134 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e303c7-aa6d-4f13-bed7-63fb3d19d36e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:53.813694 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:53.814566 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.814844 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.815114 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] PATH_INFO: `/v3/projects/a61726a3da4a46a88bd19e48cb92fcd0/users/657f14c04cc64ad38c4fc1ffbb6bff86/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.828913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61726a3da4a46a88bd19e48cb92fcd0, user_id=657f14c04cc64ad38c4fc1ffbb6bff86, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:53.831512 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:53.844709 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1407/2773] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:30:53 2022] PUT /identity/v3/projects/a61726a3da4a46a88bd19e48cb92fcd0/users/657f14c04cc64ad38c4fc1ffbb6bff86/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:30:53.850175 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46292-0081-4c3f-bcfe-2a0e411a889e None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:53.850467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46292-0081-4c3f-bcfe-2a0e411a889e None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:53.850747 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d46292-0081-4c3f-bcfe-2a0e411a889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:53.868873 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e7d46292-0081-4c3f-bcfe-2a0e411a889e None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:53.870087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e7d46292-0081-4c3f-bcfe-2a0e411a889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:53.928543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1367/2774] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:53.938132 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:53.939801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:53.996874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339a16f-8c6c-49e6-a0c5-bebce6d679a2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:54.000696 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd3057-5fbb-412f-b403-4c96971cf67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:54.001348 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3057-5fbb-412f-b403-4c96971cf67c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:54.001632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3057-5fbb-412f-b403-4c96971cf67c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:54.001909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3057-5fbb-412f-b403-4c96971cf67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:54.011345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd3057-5fbb-412f-b403-4c96971cf67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:54.012866 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd3057-5fbb-412f-b403-4c96971cf67c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:54.022243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1408/2775] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:30:58.018995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff53e7-99ab-4943-9c82-66a95eb82c6f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:58.019542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff53e7-99ab-4943-9c82-66a95eb82c6f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:58.019542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff53e7-99ab-4943-9c82-66a95eb82c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:58.050618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2cff53e7-99ab-4943-9c82-66a95eb82c6f None None] MFA Rules not processed for user `657f14c04cc64ad38c4fc1ffbb6bff86`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:30:58.051846 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2cff53e7-99ab-4943-9c82-66a95eb82c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:30:58.134057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1368/2776] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:30:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:30:58.138550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd3057-5fbb-412f-b403-4c96971cf67c service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:58.150725 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd3057-5fbb-412f-b403-4c96971cf67c service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:58.158879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a234fb1-8d2e-4590-aa1e-3cecf7be2598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:58.161052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a234fb1-8d2e-4590-aa1e-3cecf7be2598 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:58.161376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a234fb1-8d2e-4590-aa1e-3cecf7be2598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:58.161713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a234fb1-8d2e-4590-aa1e-3cecf7be2598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:58.162723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a234fb1-8d2e-4590-aa1e-3cecf7be2598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:58.166526 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a234fb1-8d2e-4590-aa1e-3cecf7be2598 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:58.198338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1409/2777] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:30:58 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:30:58.202894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff53e7-99ab-4943-9c82-66a95eb82c6f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:58.215680 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff53e7-99ab-4943-9c82-66a95eb82c6f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:58.297733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d1075-bc2d-4dc5-a696-c1c93b6377a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:58.298505 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d1075-bc2d-4dc5-a696-c1c93b6377a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:58.299131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d1075-bc2d-4dc5-a696-c1c93b6377a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:58.299131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d1075-bc2d-4dc5-a696-c1c93b6377a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:58.300020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d1075-bc2d-4dc5-a696-c1c93b6377a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:58.302626 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d1075-bc2d-4dc5-a696-c1c93b6377a3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:58.337014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:30:58.350377 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1369/2778] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:30:58 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:30:58.351536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a234fb1-8d2e-4590-aa1e-3cecf7be2598 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:58.366140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a234fb1-8d2e-4590-aa1e-3cecf7be2598 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:58.378118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f415e5-5281-424a-ae07-a29162d6a01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:58.378930 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f415e5-5281-424a-ae07-a29162d6a01b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:58.379218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f415e5-5281-424a-ae07-a29162d6a01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:58.379495 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f415e5-5281-424a-ae07-a29162d6a01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:58.380351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f415e5-5281-424a-ae07-a29162d6a01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:58.382000 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f415e5-5281-424a-ae07-a29162d6a01b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:58.397810 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1410/2779] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:30:58.405044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d1075-bc2d-4dc5-a696-c1c93b6377a3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:58.416037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d1075-bc2d-4dc5-a696-c1c93b6377a3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:58.425564 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6afba-58bb-49e3-8dbc-06c852a1463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:58.425852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6afba-58bb-49e3-8dbc-06c852a1463a admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:58.426136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6afba-58bb-49e3-8dbc-06c852a1463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:58.426413 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6afba-58bb-49e3-8dbc-06c852a1463a admin admin] PATH_INFO: `/v3/projects/58770f6c181e4706bbe30adfef830c42/users/3fb35f0f1a7b4fbb85939cc1270b89f9/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:58.449259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6afba-58bb-49e3-8dbc-06c852a1463a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58770f6c181e4706bbe30adfef830c42, user_id=3fb35f0f1a7b4fbb85939cc1270b89f9, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:58.452441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6afba-58bb-49e3-8dbc-06c852a1463a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:58.469584 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1370/2780] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:30:58 2022] PUT /identity/v3/projects/58770f6c181e4706bbe30adfef830c42/users/3fb35f0f1a7b4fbb85939cc1270b89f9/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:30:58.473923 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f415e5-5281-424a-ae07-a29162d6a01b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:58.489173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f415e5-5281-424a-ae07-a29162d6a01b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:58.565085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770447a1-61ce-4b30-aae7-5a2f941fe47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:58.566926 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770447a1-61ce-4b30-aae7-5a2f941fe47f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:58.567345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770447a1-61ce-4b30-aae7-5a2f941fe47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:58.567692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770447a1-61ce-4b30-aae7-5a2f941fe47f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:58.568863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770447a1-61ce-4b30-aae7-5a2f941fe47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:58.571243 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770447a1-61ce-4b30-aae7-5a2f941fe47f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:58.584523 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1411/2781] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:30:58.588594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6afba-58bb-49e3-8dbc-06c852a1463a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:30:58.601394 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6afba-58bb-49e3-8dbc-06c852a1463a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:30:58.606739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:30:58.607663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:30:58.607939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:30:58.608257 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] PATH_INFO: `/v3/projects/58770f6c181e4706bbe30adfef830c42/users/3fb35f0f1a7b4fbb85939cc1270b89f9/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:30:58.610342 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58770f6c181e4706bbe30adfef830c42, user_id=3fb35f0f1a7b4fbb85939cc1270b89f9, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:30:58.613160 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:30:58.626119 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1371/2782] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:30:58 2022] PUT /identity/v3/projects/58770f6c181e4706bbe30adfef830c42/users/3fb35f0f1a7b4fbb85939cc1270b89f9/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:31:03.187918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd08a0-87c0-4744-b086-f5694c7f1d64 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:31:03.188594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd08a0-87c0-4744-b086-f5694c7f1d64 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:31:03.188594 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd08a0-87c0-4744-b086-f5694c7f1d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:31:03.218447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7ecd08a0-87c0-4744-b086-f5694c7f1d64 None None] MFA Rules not processed for user `3fb35f0f1a7b4fbb85939cc1270b89f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:31:03.219713 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7ecd08a0-87c0-4744-b086-f5694c7f1d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:31:03.230864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:31:03.318598 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1412/2783] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:31:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:31:03.336956 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:31:03.340387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:31:03.427927 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74095447-f84a-4b6f-9ae2-811bb125507a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:31:03.434240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:31:03.434932 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:31:03.435254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:31:03.435501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:31:03.499821 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:31:03.501499 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:31:03.512189 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1372/2784] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:31:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:31:04.682420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520aa0-39a5-4064-bab0-8c116d4146ff None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:31:04.683264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520aa0-39a5-4064-bab0-8c116d4146ff None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:31:04.683446 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520aa0-39a5-4064-bab0-8c116d4146ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:31:04.701438 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1f520aa0-39a5-4064-bab0-8c116d4146ff None None] MFA Rules not processed for user `657f14c04cc64ad38c4fc1ffbb6bff86`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:31:04.702636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1f520aa0-39a5-4064-bab0-8c116d4146ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:31:04.710035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1413/2785] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:31:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:31:13.507281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:31:14.696354 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=27 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:31:23.439452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:31:23.440977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:31:23.511813 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3708480-4446-4e31-b7d5-78103228ef67 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:31:23.517616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:31:23.518273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:31:23.518558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:31:23.518838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:31:23.520664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:31:23.532577 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:31:23.534187 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:31:23.544727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1373/2786] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:31:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:31:33.539889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=32 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:31:34.957399 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f520aa0-39a5-4064-bab0-8c116d4146ff None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:31:35.011896 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f520aa0-39a5-4064-bab0-8c116d4146ff None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:31:35.016196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:31:35.016835 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:31:35.017189 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:31:35.017442 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:31:35.026198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:31:35.027621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:31:35.037647 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1414/2787] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:31:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:31:45.033606 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=26 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:34.225678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:34.227247 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:34.244353 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7948030-482e-4de3-9508-f4f8f7aba28e service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:34.247986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:34.248664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:34.248943 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:34.249312 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:34.275026 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:34.335772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:34.337517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:34.347686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1374/2788] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:37.330458 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:37.332306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:37.348766 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4abda-cb04-4786-b468-0567864538f4 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:37.353723 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c708544-095c-4767-b183-b405f928252b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:37.354381 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c708544-095c-4767-b183-b405f928252b service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:37.354650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c708544-095c-4767-b183-b405f928252b service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:37.354929 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c708544-095c-4767-b183-b405f928252b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:37.356841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8c708544-095c-4767-b183-b405f928252b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:37.370120 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c708544-095c-4767-b183-b405f928252b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:37.372127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c708544-095c-4767-b183-b405f928252b service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:37.383031 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1415/2789] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:37.407010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:37.408547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:37.425923 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637096d-986e-4ece-ada1-fe64a64d8337 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:37.432585 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:37.433901 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:37.434313 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:37.434712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] PATH_INFO: `/v3/users/f1ad883ea911405c847e8f166a6dfe4e` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:37.436467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ad883ea911405c847e8f166a6dfe4e)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:37.440014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:37.650512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ad883ea911405c847e8f166a6dfe4e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:37.651082 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ad883ea911405c847e8f166a6dfe4e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:37.662814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ad883ea911405c847e8f166a6dfe4e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:37.663463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ad883ea911405c847e8f166a6dfe4e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:37.671144 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09f16bc7-359e-4210-970d-3299d85c26ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ad883ea911405c847e8f166a6dfe4e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:37.683888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1375/2790] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:32:37 2022] DELETE /identity/v3/users/f1ad883ea911405c847e8f166a6dfe4e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:32:37.875568 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c708544-095c-4767-b183-b405f928252b service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:37.886245 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c708544-095c-4767-b183-b405f928252b service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:37.953445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:37.954316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:37.954603 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:37.954882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] PATH_INFO: `/v3/projects/587165be6b2844c79154d471533b115c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:37.956072 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=587165be6b2844c79154d471533b115c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:37.958013 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.004388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587165be6b2844c79154d471533b115c', 'request_id': 'req-c0b1de65-7c9a-4175-9f26-eeb1213cff12'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:38.010633 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587165be6b2844c79154d471533b115c', 'request_id': 'req-c0b1de65-7c9a-4175-9f26-eeb1213cff12'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:38.018118 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587165be6b2844c79154d471533b115c', 'request_id': 'req-c0b1de65-7c9a-4175-9f26-eeb1213cff12'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:38.029720 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] The token cache is being invalidate because project 587165be6b2844c79154d471533b115c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:32:38.030122 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:38.030937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c0b1de65-7c9a-4175-9f26-eeb1213cff12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:38.033569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1416/2791] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:32:37 2022] DELETE /identity/v3/projects/587165be6b2844c79154d471533b115c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:38.039360 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be54e-2c8c-4dcc-b3ac-eab68d6daa27 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.039646 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be54e-2c8c-4dcc-b3ac-eab68d6daa27 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.039941 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00be54e-2c8c-4dcc-b3ac-eab68d6daa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.059929 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f00be54e-2c8c-4dcc-b3ac-eab68d6daa27 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:38.061186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f00be54e-2c8c-4dcc-b3ac-eab68d6daa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:38.123816 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1376/2792] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:38.135127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b919de-12c7-40c2-a2b4-16231ae5c61d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.135454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b919de-12c7-40c2-a2b4-16231ae5c61d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.135740 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b919de-12c7-40c2-a2b4-16231ae5c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.155413 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-49b919de-12c7-40c2-a2b4-16231ae5c61d None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:38.157311 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-49b919de-12c7-40c2-a2b4-16231ae5c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:38.165371 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1417/2793] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:38.171517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00be54e-2c8c-4dcc-b3ac-eab68d6daa27 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.184504 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00be54e-2c8c-4dcc-b3ac-eab68d6daa27 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.190525 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.191418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.191804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.192222 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.193255 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:32:38.193684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.196020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.197972 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:38.219852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1377/2794] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:32:38.221621 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b919de-12c7-40c2-a2b4-16231ae5c61d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.239070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b919de-12c7-40c2-a2b4-16231ae5c61d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.247919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7319f5e-d133-4c98-9bc3-ae57afe6d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.248653 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7319f5e-d133-4c98-9bc3-ae57afe6d5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.248940 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7319f5e-d133-4c98-9bc3-ae57afe6d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.249225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7319f5e-d133-4c98-9bc3-ae57afe6d5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.249932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7319f5e-d133-4c98-9bc3-ae57afe6d5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.251850 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7319f5e-d133-4c98-9bc3-ae57afe6d5c9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.280146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1418/2795] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:38 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:38.285291 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.300273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ad0ad-bc0a-44b3-8763-554f3d90198e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.369442 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b347262-6da5-4826-859b-3d5c915b7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.370128 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347262-6da5-4826-859b-3d5c915b7de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.370488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347262-6da5-4826-859b-3d5c915b7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.370774 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b347262-6da5-4826-859b-3d5c915b7de3 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.371467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b347262-6da5-4826-859b-3d5c915b7de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.373476 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b347262-6da5-4826-859b-3d5c915b7de3 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.394284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1378/2796] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:38 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:38.398936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7319f5e-d133-4c98-9bc3-ae57afe6d5c9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.414309 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7319f5e-d133-4c98-9bc3-ae57afe6d5c9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.419743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce3e4-21e2-4de1-86e7-032832dc94ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.420622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce3e4-21e2-4de1-86e7-032832dc94ee admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.421006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce3e4-21e2-4de1-86e7-032832dc94ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.421391 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce3e4-21e2-4de1-86e7-032832dc94ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.422453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbce3e4-21e2-4de1-86e7-032832dc94ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.424816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbce3e4-21e2-4de1-86e7-032832dc94ee admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.439970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1419/2797] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:38.444663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b347262-6da5-4826-859b-3d5c915b7de3 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.456296 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b347262-6da5-4826-859b-3d5c915b7de3 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.462521 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872e727-688b-4a4c-9fb3-4855e3623d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.463218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872e727-688b-4a4c-9fb3-4855e3623d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.463501 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872e727-688b-4a4c-9fb3-4855e3623d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.463777 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872e727-688b-4a4c-9fb3-4855e3623d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.465109 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872e727-688b-4a4c-9fb3-4855e3623d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.467072 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872e727-688b-4a4c-9fb3-4855e3623d28 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.478550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1379/2798] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:32:38.482860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce3e4-21e2-4de1-86e7-032832dc94ee admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.493014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce3e4-21e2-4de1-86e7-032832dc94ee admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.497610 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5350e98-f86d-46f2-a0e5-26e0cc26c8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.498481 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5350e98-f86d-46f2-a0e5-26e0cc26c8dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.498767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5350e98-f86d-46f2-a0e5-26e0cc26c8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.499060 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5350e98-f86d-46f2-a0e5-26e0cc26c8dc admin admin] PATH_INFO: `/v3/projects/63b10b2775ba45dcae0349754c2b79a4/users/4b002f6e7d4946ad9d10e7d7b5b2692e/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.514871 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5350e98-f86d-46f2-a0e5-26e0cc26c8dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b10b2775ba45dcae0349754c2b79a4, user_id=4b002f6e7d4946ad9d10e7d7b5b2692e, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.518116 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5350e98-f86d-46f2-a0e5-26e0cc26c8dc admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.534081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1420/2799] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:38 2022] PUT /identity/v3/projects/63b10b2775ba45dcae0349754c2b79a4/users/4b002f6e7d4946ad9d10e7d7b5b2692e/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:38.544814 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc425-c863-4b89-9104-0c412886ed79 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.545107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc425-c863-4b89-9104-0c412886ed79 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.545381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bc425-c863-4b89-9104-0c412886ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.575127 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-2f0bc425-c863-4b89-9104-0c412886ed79 None None] MFA Rules not processed for user `4b002f6e7d4946ad9d10e7d7b5b2692e`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:38.576375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2f0bc425-c863-4b89-9104-0c412886ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:38.643039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1380/2800] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:38.647560 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5350e98-f86d-46f2-a0e5-26e0cc26c8dc admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.660727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:38.711306 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5350e98-f86d-46f2-a0e5-26e0cc26c8dc admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.716130 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd3ff3-44f1-4a6d-aa7a-7c130729c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.716790 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3ff3-44f1-4a6d-aa7a-7c130729c33a admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.717076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3ff3-44f1-4a6d-aa7a-7c130729c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.717355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd3ff3-44f1-4a6d-aa7a-7c130729c33a admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.718054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd3ff3-44f1-4a6d-aa7a-7c130729c33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.719996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd3ff3-44f1-4a6d-aa7a-7c130729c33a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.749673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1421/2801] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:38 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:38.757533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bc425-c863-4b89-9104-0c412886ed79 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.771135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bc425-c863-4b89-9104-0c412886ed79 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.828967 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c84e1-6509-44aa-8b12-7c77566613d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.829649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c84e1-6509-44aa-8b12-7c77566613d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.829934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c84e1-6509-44aa-8b12-7c77566613d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.830212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c84e1-6509-44aa-8b12-7c77566613d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.831114 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c84e1-6509-44aa-8b12-7c77566613d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.833056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c84e1-6509-44aa-8b12-7c77566613d7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.840975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:38.853787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1381/2802] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:38 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:38.857800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd3ff3-44f1-4a6d-aa7a-7c130729c33a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.868680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd3ff3-44f1-4a6d-aa7a-7c130729c33a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.873372 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79f48-c79b-4705-ba9f-4a4cc64c5f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.874079 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79f48-c79b-4705-ba9f-4a4cc64c5f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.874322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79f48-c79b-4705-ba9f-4a4cc64c5f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.874602 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79f48-c79b-4705-ba9f-4a4cc64c5f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.875882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f79f48-c79b-4705-ba9f-4a4cc64c5f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.877517 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f79f48-c79b-4705-ba9f-4a4cc64c5f39 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.888160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1422/2803] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:38.892261 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c84e1-6509-44aa-8b12-7c77566613d7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.902202 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c84e1-6509-44aa-8b12-7c77566613d7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.906852 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b1789-814f-4b03-b8d6-6a1bd3d8b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.907563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b1789-814f-4b03-b8d6-6a1bd3d8b22e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.907847 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b1789-814f-4b03-b8d6-6a1bd3d8b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.908142 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b1789-814f-4b03-b8d6-6a1bd3d8b22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.908902 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b1789-814f-4b03-b8d6-6a1bd3d8b22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.910497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b1789-814f-4b03-b8d6-6a1bd3d8b22e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.920682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1382/2804] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:32:38.925450 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79f48-c79b-4705-ba9f-4a4cc64c5f39 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:38.935465 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79f48-c79b-4705-ba9f-4a4cc64c5f39 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:38.941041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79396-91db-44b5-85a5-d3a6e07620f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:38.941910 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79396-91db-44b5-85a5-d3a6e07620f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.942197 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79396-91db-44b5-85a5-d3a6e07620f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.942477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf79396-91db-44b5-85a5-d3a6e07620f4 admin admin] PATH_INFO: `/v3/projects/0649016c18504e72a2e5658a5d688843/users/b210a00cfec746c0a63b974a21ba2b4c/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:38.957417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79396-91db-44b5-85a5-d3a6e07620f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0649016c18504e72a2e5658a5d688843, user_id=b210a00cfec746c0a63b974a21ba2b4c, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:38.960217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf79396-91db-44b5-85a5-d3a6e07620f4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:38.974378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1423/2805] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:38 2022] PUT /identity/v3/projects/0649016c18504e72a2e5658a5d688843/users/b210a00cfec746c0a63b974a21ba2b4c/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:38.986376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371156fb-251a-4f9f-9df9-9733c0642771 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:38.986663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371156fb-251a-4f9f-9df9-9733c0642771 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:38.986939 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371156fb-251a-4f9f-9df9-9733c0642771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.014593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-371156fb-251a-4f9f-9df9-9733c0642771 None None] MFA Rules not processed for user `b210a00cfec746c0a63b974a21ba2b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:39.015808 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-371156fb-251a-4f9f-9df9-9733c0642771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:39.100973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1383/2806] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:39.105833 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79396-91db-44b5-85a5-d3a6e07620f4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:39.175498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf79396-91db-44b5-85a5-d3a6e07620f4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:39.180488 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da3c9f-59e9-4999-9709-e7a3eeca30dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:39.181161 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3c9f-59e9-4999-9709-e7a3eeca30dc admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:39.181447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3c9f-59e9-4999-9709-e7a3eeca30dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:39.181730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da3c9f-59e9-4999-9709-e7a3eeca30dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.182437 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da3c9f-59e9-4999-9709-e7a3eeca30dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:39.184780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da3c9f-59e9-4999-9709-e7a3eeca30dc admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:39.223612 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1424/2807] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:39 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:39.228739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371156fb-251a-4f9f-9df9-9733c0642771 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:39.241263 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371156fb-251a-4f9f-9df9-9733c0642771 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:39.300199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb051d-a8ab-4bdd-b9b4-45e2d5138097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:39.300887 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb051d-a8ab-4bdd-b9b4-45e2d5138097 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:39.301230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb051d-a8ab-4bdd-b9b4-45e2d5138097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:39.301452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb051d-a8ab-4bdd-b9b4-45e2d5138097 admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.302157 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb051d-a8ab-4bdd-b9b4-45e2d5138097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:39.304158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb051d-a8ab-4bdd-b9b4-45e2d5138097 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:39.325131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1384/2808] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:39 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:39.329590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da3c9f-59e9-4999-9709-e7a3eeca30dc admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:39.341506 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da3c9f-59e9-4999-9709-e7a3eeca30dc admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:39.349570 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b295d2-fbc6-4695-910f-05249433593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:39.350253 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b295d2-fbc6-4695-910f-05249433593b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:39.350539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b295d2-fbc6-4695-910f-05249433593b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:39.350817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b295d2-fbc6-4695-910f-05249433593b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.351553 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b295d2-fbc6-4695-910f-05249433593b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:39.353328 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b295d2-fbc6-4695-910f-05249433593b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:39.366097 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1425/2809] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:39.379405 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb051d-a8ab-4bdd-b9b4-45e2d5138097 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:39.392457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb051d-a8ab-4bdd-b9b4-45e2d5138097 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:39.399091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d36320-0967-476a-ae4d-b2c6e8481eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:39.400667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d36320-0967-476a-ae4d-b2c6e8481eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:39.401125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d36320-0967-476a-ae4d-b2c6e8481eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:39.401580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d36320-0967-476a-ae4d-b2c6e8481eab admin admin] PATH_INFO: `/v3/projects/46bee191fdc34c66aa5c7419571bcfb7/users/c4bbec6944934d4781deb118aef48731/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.420660 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d36320-0967-476a-ae4d-b2c6e8481eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bee191fdc34c66aa5c7419571bcfb7, user_id=c4bbec6944934d4781deb118aef48731, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:39.424790 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d36320-0967-476a-ae4d-b2c6e8481eab admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:39.439594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1385/2810] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:39 2022] PUT /identity/v3/projects/46bee191fdc34c66aa5c7419571bcfb7/users/c4bbec6944934d4781deb118aef48731/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:39.444068 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b295d2-fbc6-4695-910f-05249433593b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:39.454424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b295d2-fbc6-4695-910f-05249433593b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:39.497756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:39.525769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbec4e9-201a-447b-ae7b-c956b6a2b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:39.526474 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec4e9-201a-447b-ae7b-c956b6a2b975 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:39.526758 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec4e9-201a-447b-ae7b-c956b6a2b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:39.527041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec4e9-201a-447b-ae7b-c956b6a2b975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.527820 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbec4e9-201a-447b-ae7b-c956b6a2b975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:39.529597 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbec4e9-201a-447b-ae7b-c956b6a2b975 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:39.540049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1426/2811] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:39.544332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d36320-0967-476a-ae4d-b2c6e8481eab admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:39.554799 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d36320-0967-476a-ae4d-b2c6e8481eab admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:39.559671 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:39.560618 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:39.560895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:39.561167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] PATH_INFO: `/v3/projects/46bee191fdc34c66aa5c7419571bcfb7/users/c4bbec6944934d4781deb118aef48731/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.563675 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bee191fdc34c66aa5c7419571bcfb7, user_id=c4bbec6944934d4781deb118aef48731, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:39.566392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:39.576836 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1386/2812] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:39 2022] PUT /identity/v3/projects/46bee191fdc34c66aa5c7419571bcfb7/users/c4bbec6944934d4781deb118aef48731/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:39.587943 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f481829-c1de-478a-960c-19c3606ab360 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:39.588286 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f481829-c1de-478a-960c-19c3606ab360 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:39.588565 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f481829-c1de-478a-960c-19c3606ab360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.614758 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6f481829-c1de-478a-960c-19c3606ab360 None None] MFA Rules not processed for user `c4bbec6944934d4781deb118aef48731`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:39.615962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6f481829-c1de-478a-960c-19c3606ab360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:39.685786 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1427/2813] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:39.697204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:39.698970 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:39.726036 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:39.759115 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715663a-0e0b-424b-a9e4-fdba65d58e8f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:39.762809 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c508d-75b4-456e-be19-c23aa2300389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:39.763453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c508d-75b4-456e-be19-c23aa2300389 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:39.763737 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c508d-75b4-456e-be19-c23aa2300389 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:39.764015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c508d-75b4-456e-be19-c23aa2300389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:39.773208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c508d-75b4-456e-be19-c23aa2300389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:39.774736 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c508d-75b4-456e-be19-c23aa2300389 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:39.784962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1387/2814] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:40.293536 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f481829-c1de-478a-960c-19c3606ab360 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:40.294948 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6f481829-c1de-478a-960c-19c3606ab360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:40.307128 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f481829-c1de-478a-960c-19c3606ab360 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:40.310585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7f0d-9703-4a48-a77e-e085c1fd59cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:40.311225 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7f0d-9703-4a48-a77e-e085c1fd59cb service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:40.311508 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7f0d-9703-4a48-a77e-e085c1fd59cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:40.311784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7f0d-9703-4a48-a77e-e085c1fd59cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:40.372818 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7f0d-9703-4a48-a77e-e085c1fd59cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:40.374280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7f0d-9703-4a48-a77e-e085c1fd59cb service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:40.383937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1428/2815] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:44.425123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c508d-75b4-456e-be19-c23aa2300389 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:44.433874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c508d-75b4-456e-be19-c23aa2300389 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:44.437605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65feca72-b096-416d-9f98-1409fbfe8a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:44.438895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feca72-b096-416d-9f98-1409fbfe8a5a service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:44.439178 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feca72-b096-416d-9f98-1409fbfe8a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:44.439452 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feca72-b096-416d-9f98-1409fbfe8a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:44.495550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65feca72-b096-416d-9f98-1409fbfe8a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:44.496946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65feca72-b096-416d-9f98-1409fbfe8a5a service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:44.506648 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1388/2816] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:46.545476 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7f0d-9703-4a48-a77e-e085c1fd59cb service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:46.603262 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:46.607395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7f0d-9703-4a48-a77e-e085c1fd59cb service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:46.612596 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:46.613461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:46.613739 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:46.614012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] PATH_INFO: `/v3/users/4b002f6e7d4946ad9d10e7d7b5b2692e` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:46.615185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b002f6e7d4946ad9d10e7d7b5b2692e)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:46.617261 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:46.663473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b002f6e7d4946ad9d10e7d7b5b2692e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:46.664184 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b002f6e7d4946ad9d10e7d7b5b2692e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:46.670972 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b002f6e7d4946ad9d10e7d7b5b2692e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:46.678151 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b002f6e7d4946ad9d10e7d7b5b2692e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:46.678779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b002f6e7d4946ad9d10e7d7b5b2692e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:46.696454 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1429/2817] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:32:46 2022] DELETE /identity/v3/users/4b002f6e7d4946ad9d10e7d7b5b2692e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:46.701015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1125d-ff6a-4a74-9a86-848b6a70b902 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:46.701566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1125d-ff6a-4a74-9a86-848b6a70b902 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:46.701566 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1125d-ff6a-4a74-9a86-848b6a70b902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:46.719659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-d8f1125d-ff6a-4a74-9a86-848b6a70b902 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:46.720845 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d8f1125d-ff6a-4a74-9a86-848b6a70b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:46.777233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1389/2818] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:46.787421 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:46.788857 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:46.845298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627223-df52-4d97-aa03-13ebb5c215bb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:46.849203 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1468-b4c1-422e-8176-fe6a6f9439a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:46.849860 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1468-b4c1-422e-8176-fe6a6f9439a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:46.850144 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1468-b4c1-422e-8176-fe6a6f9439a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:46.850420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e1468-b4c1-422e-8176-fe6a6f9439a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:46.859700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e1468-b4c1-422e-8176-fe6a6f9439a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:46.861685 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e1468-b4c1-422e-8176-fe6a6f9439a0 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:46.871070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1430/2819] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:47.140472 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1125d-ff6a-4a74-9a86-848b6a70b902 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:47.142433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-d8f1125d-ff6a-4a74-9a86-848b6a70b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:47.156207 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1125d-ff6a-4a74-9a86-848b6a70b902 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:47.161345 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:47.162204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:47.162488 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:47.162759 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] PATH_INFO: `/v3/projects/63b10b2775ba45dcae0349754c2b79a4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:47.163933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b10b2775ba45dcae0349754c2b79a4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:47.166631 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:47.224315 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b10b2775ba45dcae0349754c2b79a4', 'request_id': 'req-23e9f0bb-5808-4b58-bf96-c2720c4324b7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.230267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b10b2775ba45dcae0349754c2b79a4', 'request_id': 'req-23e9f0bb-5808-4b58-bf96-c2720c4324b7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.231921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:47.243021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b10b2775ba45dcae0349754c2b79a4', 'request_id': 'req-23e9f0bb-5808-4b58-bf96-c2720c4324b7'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.255642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] The token cache is being invalidate because project 63b10b2775ba45dcae0349754c2b79a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:32:47.255926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.256732 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.258198 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1390/2820] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:32:47 2022] DELETE /identity/v3/projects/63b10b2775ba45dcae0349754c2b79a4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:32:47.262434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1468-b4c1-422e-8176-fe6a6f9439a0 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:47.272705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e1468-b4c1-422e-8176-fe6a6f9439a0 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:47.329484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:47.330370 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:47.330716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:47.331140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] PATH_INFO: `/v3/users/b210a00cfec746c0a63b974a21ba2b4c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:47.332558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b210a00cfec746c0a63b974a21ba2b4c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:47.334473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:47.356419 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:47.381768 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b210a00cfec746c0a63b974a21ba2b4c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.382423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b210a00cfec746c0a63b974a21ba2b4c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.389181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b210a00cfec746c0a63b974a21ba2b4c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.397445 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b210a00cfec746c0a63b974a21ba2b4c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.398183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b210a00cfec746c0a63b974a21ba2b4c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.416165 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1431/2821] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:32:47 2022] DELETE /identity/v3/users/b210a00cfec746c0a63b974a21ba2b4c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:47.712701 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:47.714174 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:47.727392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9f0bb-5808-4b58-bf96-c2720c4324b7 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:47.785934 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:47.786712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:47.786996 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:47.787277 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] PATH_INFO: `/v3/projects/0649016c18504e72a2e5658a5d688843` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:47.788487 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0649016c18504e72a2e5658a5d688843)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:47.790388 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:47.837371 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0649016c18504e72a2e5658a5d688843', 'request_id': 'req-32697e07-2273-4f87-96f1-4060c7fdb47e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.842844 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0649016c18504e72a2e5658a5d688843', 'request_id': 'req-32697e07-2273-4f87-96f1-4060c7fdb47e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.850308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0649016c18504e72a2e5658a5d688843', 'request_id': 'req-32697e07-2273-4f87-96f1-4060c7fdb47e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.862143 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] The token cache is being invalidate because project 0649016c18504e72a2e5658a5d688843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:32:47.862430 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.863081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.864654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1391/2822] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:32:47 2022] DELETE /identity/v3/projects/0649016c18504e72a2e5658a5d688843 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:47.868595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:47.869985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:47.883509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044651d-834f-416a-948f-eea04d05ee0d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:47.940780 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:47.941675 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:47.941954 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:47.942426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] PATH_INFO: `/v3/users/c4bbec6944934d4781deb118aef48731` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:47.943728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4bbec6944934d4781deb118aef48731)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:47.945671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:47.991856 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4bbec6944934d4781deb118aef48731'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.992521 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4bbec6944934d4781deb118aef48731'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:47.999408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4bbec6944934d4781deb118aef48731'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:48.007658 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4bbec6944934d4781deb118aef48731'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:48.008444 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb3c239-bd63-4a17-b62c-0c3cf0b90075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4bbec6944934d4781deb118aef48731'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:48.026962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1432/2823] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:32:47 2022] DELETE /identity/v3/users/c4bbec6944934d4781deb118aef48731 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:48.304649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:48.306108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:48.325218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32697e07-2273-4f87-96f1-4060c7fdb47e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:48.383580 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:48.384469 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.384753 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.385029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] PATH_INFO: `/v3/projects/46bee191fdc34c66aa5c7419571bcfb7` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.386199 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bee191fdc34c66aa5c7419571bcfb7)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:48.388123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:48.408827 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:48.437422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bee191fdc34c66aa5c7419571bcfb7', 'request_id': 'req-1cc2f3b7-ad3e-426d-af69-131be2121ddd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:48.443156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bee191fdc34c66aa5c7419571bcfb7', 'request_id': 'req-1cc2f3b7-ad3e-426d-af69-131be2121ddd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:48.450796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bee191fdc34c66aa5c7419571bcfb7', 'request_id': 'req-1cc2f3b7-ad3e-426d-af69-131be2121ddd'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:48.462123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] The token cache is being invalidate because project 46bee191fdc34c66aa5c7419571bcfb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:32:48.462412 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:48.463043 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-1cc2f3b7-ad3e-426d-af69-131be2121ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:48.464642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1392/2824] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:32:48 2022] DELETE /identity/v3/projects/46bee191fdc34c66aa5c7419571bcfb7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:48.471107 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65f103-6fea-4162-b50e-597790fd4dfb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.471398 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65f103-6fea-4162-b50e-597790fd4dfb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.471674 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65f103-6fea-4162-b50e-597790fd4dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.489918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5a65f103-6fea-4162-b50e-597790fd4dfb None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:48.491127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5a65f103-6fea-4162-b50e-597790fd4dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:48.503622 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:48.552738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1433/2825] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 11:32:48.561162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1cda5-bb89-4e70-b3e3-fac1aa618ae5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.561451 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1cda5-bb89-4e70-b3e3-fac1aa618ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.561725 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1cda5-bb89-4e70-b3e3-fac1aa618ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.580651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-3ad1cda5-bb89-4e70-b3e3-fac1aa618ae5 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:48.581857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3ad1cda5-bb89-4e70-b3e3-fac1aa618ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:48.589955 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1393/2826] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:48.594289 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65f103-6fea-4162-b50e-597790fd4dfb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:48.603904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65f103-6fea-4162-b50e-597790fd4dfb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:48.609096 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:48.610462 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.610748 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.611025 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.611794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:32:48.612100 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:48.613732 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:48.626374 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1434/2827] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:32:48.630872 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1cda5-bb89-4e70-b3e3-fac1aa618ae5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:48.642389 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1cda5-bb89-4e70-b3e3-fac1aa618ae5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:48.648223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a749c2-b8ef-4b95-8fed-17cdeffdfe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:48.648878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a749c2-b8ef-4b95-8fed-17cdeffdfe7f admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.649159 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a749c2-b8ef-4b95-8fed-17cdeffdfe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.649432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a749c2-b8ef-4b95-8fed-17cdeffdfe7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.650125 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a749c2-b8ef-4b95-8fed-17cdeffdfe7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:48.652018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a749c2-b8ef-4b95-8fed-17cdeffdfe7f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:48.678795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1394/2828] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:48 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:32:48.683494 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:48.694098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e3588-b402-4806-8820-e5544c4868bf admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:48.750396 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7321-beb3-44f5-b0c4-ab48bcf6ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:48.751550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7321-beb3-44f5-b0c4-ab48bcf6ba0f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.751828 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7321-beb3-44f5-b0c4-ab48bcf6ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.752121 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed7321-beb3-44f5-b0c4-ab48bcf6ba0f admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.752812 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7321-beb3-44f5-b0c4-ab48bcf6ba0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:48.754714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed7321-beb3-44f5-b0c4-ab48bcf6ba0f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:48.774411 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1435/2829] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:48 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:48.778457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a749c2-b8ef-4b95-8fed-17cdeffdfe7f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:48.788951 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a749c2-b8ef-4b95-8fed-17cdeffdfe7f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:48.793510 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ee80-e05a-488d-a718-911d76cf3c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:48.794161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ee80-e05a-488d-a718-911d76cf3c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.794446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ee80-e05a-488d-a718-911d76cf3c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.794719 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ee80-e05a-488d-a718-911d76cf3c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.795466 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ee80-e05a-488d-a718-911d76cf3c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:48.797075 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ee80-e05a-488d-a718-911d76cf3c4e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:48.809223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1395/2830] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:48.813632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7321-beb3-44f5-b0c4-ab48bcf6ba0f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:48.823642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed7321-beb3-44f5-b0c4-ab48bcf6ba0f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:48.828397 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838825d6-7e8a-4d7a-b6ec-4a0ace2dfdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:48.829035 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838825d6-7e8a-4d7a-b6ec-4a0ace2dfdba admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.829323 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838825d6-7e8a-4d7a-b6ec-4a0ace2dfdba admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.829607 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838825d6-7e8a-4d7a-b6ec-4a0ace2dfdba admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.830337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838825d6-7e8a-4d7a-b6ec-4a0ace2dfdba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:48.831934 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838825d6-7e8a-4d7a-b6ec-4a0ace2dfdba admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:48.842183 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1436/2831] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 11:32:48.846931 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ee80-e05a-488d-a718-911d76cf3c4e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:48.857041 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ee80-e05a-488d-a718-911d76cf3c4e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:48.862248 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d400e-34e4-48fd-b7e0-dc015bb0ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:48.863121 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d400e-34e4-48fd-b7e0-dc015bb0ab41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.863433 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d400e-34e4-48fd-b7e0-dc015bb0ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.863711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d400e-34e4-48fd-b7e0-dc015bb0ab41 admin admin] PATH_INFO: `/v3/projects/53ff2c49a8b147b0ba137739c0cfe3c2/users/90e4cec9cb7c4102ab17625f91b58943/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.878649 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d400e-34e4-48fd-b7e0-dc015bb0ab41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ff2c49a8b147b0ba137739c0cfe3c2, user_id=90e4cec9cb7c4102ab17625f91b58943, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:48.881322 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d400e-34e4-48fd-b7e0-dc015bb0ab41 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:48.893667 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1396/2832] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:48 2022] PUT /identity/v3/projects/53ff2c49a8b147b0ba137739c0cfe3c2/users/90e4cec9cb7c4102ab17625f91b58943/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:32:48.957591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae798d-a1b0-446a-ba94-26c098abf8e7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:48.958167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae798d-a1b0-446a-ba94-26c098abf8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:48.958167 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae798d-a1b0-446a-ba94-26c098abf8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:48.986704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-92ae798d-a1b0-446a-ba94-26c098abf8e7 None None] MFA Rules not processed for user `90e4cec9cb7c4102ab17625f91b58943`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:48.987937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-92ae798d-a1b0-446a-ba94-26c098abf8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:49.049153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1437/2833] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:49.053928 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d400e-34e4-48fd-b7e0-dc015bb0ab41 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.117771 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d400e-34e4-48fd-b7e0-dc015bb0ab41 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.122385 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cb3cb-c13e-432e-87ce-f4e42e5b1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.123037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb3cb-c13e-432e-87ce-f4e42e5b1b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.123319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb3cb-c13e-432e-87ce-f4e42e5b1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.123593 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cb3cb-c13e-432e-87ce-f4e42e5b1b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.124305 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cb3cb-c13e-432e-87ce-f4e42e5b1b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.126182 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cb3cb-c13e-432e-87ce-f4e42e5b1b13 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.150454 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1397/2834] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:49 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:49.154642 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae798d-a1b0-446a-ba94-26c098abf8e7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.165638 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae798d-a1b0-446a-ba94-26c098abf8e7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.174729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:49.225643 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c632b-bdef-4e77-bc09-94e32b755eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.226326 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c632b-bdef-4e77-bc09-94e32b755eef admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.226613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c632b-bdef-4e77-bc09-94e32b755eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.226893 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c632b-bdef-4e77-bc09-94e32b755eef admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.227581 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c632b-bdef-4e77-bc09-94e32b755eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.229546 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c632b-bdef-4e77-bc09-94e32b755eef admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.254376 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1438/2835] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:49 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:49.258798 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cb3cb-c13e-432e-87ce-f4e42e5b1b13 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.272770 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cb3cb-c13e-432e-87ce-f4e42e5b1b13 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.277563 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a44c-df92-4add-9758-327e0d08d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.278240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a44c-df92-4add-9758-327e0d08d0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.278524 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a44c-df92-4add-9758-327e0d08d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.278804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a44c-df92-4add-9758-327e0d08d0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.279533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9a44c-df92-4add-9758-327e0d08d0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.281210 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9a44c-df92-4add-9758-327e0d08d0e0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.292717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1398/2836] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:49.297093 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c632b-bdef-4e77-bc09-94e32b755eef admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.307800 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c632b-bdef-4e77-bc09-94e32b755eef admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.312591 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897569b8-8f36-4093-b574-11e71f77b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.313322 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897569b8-8f36-4093-b574-11e71f77b04b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.313605 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897569b8-8f36-4093-b574-11e71f77b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.313881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897569b8-8f36-4093-b574-11e71f77b04b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.314613 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897569b8-8f36-4093-b574-11e71f77b04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.316256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897569b8-8f36-4093-b574-11e71f77b04b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.326574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1439/2837] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:49.331204 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a44c-df92-4add-9758-327e0d08d0e0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.341439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a44c-df92-4add-9758-327e0d08d0e0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.346903 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75072a0-f202-4f0d-b569-35efac6c6485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.347796 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75072a0-f202-4f0d-b569-35efac6c6485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.348081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75072a0-f202-4f0d-b569-35efac6c6485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.348387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75072a0-f202-4f0d-b569-35efac6c6485 admin admin] PATH_INFO: `/v3/projects/1e492684ad00495e90fca04342d5a0ce/users/e2dde88982d54217b41b974f8069ed2f/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.363380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75072a0-f202-4f0d-b569-35efac6c6485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e492684ad00495e90fca04342d5a0ce, user_id=e2dde88982d54217b41b974f8069ed2f, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.366046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75072a0-f202-4f0d-b569-35efac6c6485 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.368410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:49.381962 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1399/2838] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:49 2022] PUT /identity/v3/projects/1e492684ad00495e90fca04342d5a0ce/users/e2dde88982d54217b41b974f8069ed2f/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:49.392793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022be6f-84a7-4f24-9934-8fb15e6fa090 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.393082 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022be6f-84a7-4f24-9934-8fb15e6fa090 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.393356 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022be6f-84a7-4f24-9934-8fb15e6fa090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.420962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6022be6f-84a7-4f24-9934-8fb15e6fa090 None None] MFA Rules not processed for user `e2dde88982d54217b41b974f8069ed2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:49.422248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6022be6f-84a7-4f24-9934-8fb15e6fa090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:49.489257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1440/2839] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:49.494432 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75072a0-f202-4f0d-b569-35efac6c6485 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.562629 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75072a0-f202-4f0d-b569-35efac6c6485 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.567448 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de366825-c468-4d73-bdbe-73cba0087d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.568131 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366825-c468-4d73-bdbe-73cba0087d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.568418 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366825-c468-4d73-bdbe-73cba0087d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.568693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de366825-c468-4d73-bdbe-73cba0087d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.569511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de366825-c468-4d73-bdbe-73cba0087d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.571307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de366825-c468-4d73-bdbe-73cba0087d39 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.604804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1400/2840] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:49 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:49.609273 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022be6f-84a7-4f24-9934-8fb15e6fa090 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.621984 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022be6f-84a7-4f24-9934-8fb15e6fa090 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.681499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8841-6bed-434e-8167-f15a7bffc471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.682388 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8841-6bed-434e-8167-f15a7bffc471 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.682673 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8841-6bed-434e-8167-f15a7bffc471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.682977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a8841-6bed-434e-8167-f15a7bffc471 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.683680 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a8841-6bed-434e-8167-f15a7bffc471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.685634 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a8841-6bed-434e-8167-f15a7bffc471 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.706558 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1441/2841] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:49 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:49.710650 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de366825-c468-4d73-bdbe-73cba0087d39 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.721895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de366825-c468-4d73-bdbe-73cba0087d39 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.726616 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc149f78-b2ee-4ba8-aa83-8032971e9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.727463 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc149f78-b2ee-4ba8-aa83-8032971e9974 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.727863 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc149f78-b2ee-4ba8-aa83-8032971e9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.728236 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc149f78-b2ee-4ba8-aa83-8032971e9974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.729049 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc149f78-b2ee-4ba8-aa83-8032971e9974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.730712 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc149f78-b2ee-4ba8-aa83-8032971e9974 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.742314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1401/2842] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:49.746728 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8841-6bed-434e-8167-f15a7bffc471 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.756911 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a8841-6bed-434e-8167-f15a7bffc471 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.761439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcb7dd-8426-466e-a8ce-53eb4e61a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.762310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb7dd-8426-466e-a8ce-53eb4e61a352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.762589 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb7dd-8426-466e-a8ce-53eb4e61a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.762862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb7dd-8426-466e-a8ce-53eb4e61a352 admin admin] PATH_INFO: `/v3/projects/b1deb2ab2794444ea9ae90a82ae025e3/users/80ea12dcb9a64b6fb7b3d3d892b87217/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.771471 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:49.779692 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcb7dd-8426-466e-a8ce-53eb4e61a352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1deb2ab2794444ea9ae90a82ae025e3, user_id=80ea12dcb9a64b6fb7b3d3d892b87217, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.783727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcb7dd-8426-466e-a8ce-53eb4e61a352 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.799003 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1442/2843] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:49 2022] PUT /identity/v3/projects/b1deb2ab2794444ea9ae90a82ae025e3/users/80ea12dcb9a64b6fb7b3d3d892b87217/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:49.803234 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc149f78-b2ee-4ba8-aa83-8032971e9974 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.813820 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc149f78-b2ee-4ba8-aa83-8032971e9974 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.870733 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e20898-2c83-4617-b1ce-b26e35e1a0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.871401 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20898-2c83-4617-b1ce-b26e35e1a0af admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.871688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20898-2c83-4617-b1ce-b26e35e1a0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.871965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e20898-2c83-4617-b1ce-b26e35e1a0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.872803 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e20898-2c83-4617-b1ce-b26e35e1a0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.874343 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e20898-2c83-4617-b1ce-b26e35e1a0af admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.883946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1402/2844] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:49.888333 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcb7dd-8426-466e-a8ce-53eb4e61a352 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:49.898629 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcb7dd-8426-466e-a8ce-53eb4e61a352 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:49.903259 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:49.904201 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.904489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.904769 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] PATH_INFO: `/v3/projects/b1deb2ab2794444ea9ae90a82ae025e3/users/80ea12dcb9a64b6fb7b3d3d892b87217/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.907320 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1deb2ab2794444ea9ae90a82ae025e3, user_id=80ea12dcb9a64b6fb7b3d3d892b87217, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:49.909993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:49.920076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1443/2845] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:49 2022] PUT /identity/v3/projects/b1deb2ab2794444ea9ae90a82ae025e3/users/80ea12dcb9a64b6fb7b3d3d892b87217/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:49.932233 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b06d9-8418-4913-b10d-70b74ae7b90f None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:49.932533 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b06d9-8418-4913-b10d-70b74ae7b90f None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:49.932815 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b06d9-8418-4913-b10d-70b74ae7b90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:49.959002 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-1c7b06d9-8418-4913-b10d-70b74ae7b90f None None] MFA Rules not processed for user `80ea12dcb9a64b6fb7b3d3d892b87217`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:49.960273 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1c7b06d9-8418-4913-b10d-70b74ae7b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:50.019889 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:50.040441 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1403/2846] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:50.051817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:50.053595 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:50.110944 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf39b7-5a06-4d4e-bdcd-6489ae2ca6de admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:50.114623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cb583-64ff-48fd-a48e-613db9be5625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:50.115260 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb583-64ff-48fd-a48e-613db9be5625 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:50.115549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb583-64ff-48fd-a48e-613db9be5625 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:50.115823 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cb583-64ff-48fd-a48e-613db9be5625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:50.124898 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cb583-64ff-48fd-a48e-613db9be5625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:50.126899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7cb583-64ff-48fd-a48e-613db9be5625 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:50.136477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1444/2847] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:50.175325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b06d9-8418-4913-b10d-70b74ae7b90f None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:50.176727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-1c7b06d9-8418-4913-b10d-70b74ae7b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:50.189584 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b06d9-8418-4913-b10d-70b74ae7b90f None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:50.193148 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b27a5-1c5b-4c9a-a2d5-4c5e1a1583fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:50.193781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b27a5-1c5b-4c9a-a2d5-4c5e1a1583fc service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:50.194057 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b27a5-1c5b-4c9a-a2d5-4c5e1a1583fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:50.194327 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b27a5-1c5b-4c9a-a2d5-4c5e1a1583fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:50.252575 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b27a5-1c5b-4c9a-a2d5-4c5e1a1583fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:50.254014 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b27a5-1c5b-4c9a-a2d5-4c5e1a1583fc service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:50.262762 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1404/2848] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:53.132005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cb583-64ff-48fd-a48e-613db9be5625 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:53.192847 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cb583-64ff-48fd-a48e-613db9be5625 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:53.197477 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:53.198345 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:53.198669 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:53.198990 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] PATH_INFO: `/v3/users/90e4cec9cb7c4102ab17625f91b58943` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:53.200304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e4cec9cb7c4102ab17625f91b58943)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:53.202714 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:53.251298 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e4cec9cb7c4102ab17625f91b58943'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.252043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e4cec9cb7c4102ab17625f91b58943'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.260528 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e4cec9cb7c4102ab17625f91b58943'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.267793 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e4cec9cb7c4102ab17625f91b58943'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.268417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e4cec9cb7c4102ab17625f91b58943'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.279397 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:53.287538 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1445/2849] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:32:53 2022] DELETE /identity/v3/users/90e4cec9cb7c4102ab17625f91b58943 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:53.292218 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfce1d-d63b-4969-852d-d17c9cbd4cb0 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:53.292698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfce1d-d63b-4969-852d-d17c9cbd4cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:53.292698 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfce1d-d63b-4969-852d-d17c9cbd4cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:53.310518 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f6dfce1d-d63b-4969-852d-d17c9cbd4cb0 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:53.311738 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f6dfce1d-d63b-4969-852d-d17c9cbd4cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:53.379722 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1405/2850] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:53.389484 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:53.391002 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:53.451051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a5d8e-be84-4c0c-b57f-c7559c6c767d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:53.454529 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c677efe-60ce-40c1-8b38-0180add1bf10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:53.455194 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c677efe-60ce-40c1-8b38-0180add1bf10 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:53.455470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c677efe-60ce-40c1-8b38-0180add1bf10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:53.455744 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c677efe-60ce-40c1-8b38-0180add1bf10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:53.465660 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c677efe-60ce-40c1-8b38-0180add1bf10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:53.467115 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c677efe-60ce-40c1-8b38-0180add1bf10 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:53.477678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1446/2851] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:53.786191 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfce1d-d63b-4969-852d-d17c9cbd4cb0 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:53.787615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f6dfce1d-d63b-4969-852d-d17c9cbd4cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:53.799624 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfce1d-d63b-4969-852d-d17c9cbd4cb0 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:53.804841 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:53.805707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:53.805986 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:53.806307 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] PATH_INFO: `/v3/projects/53ff2c49a8b147b0ba137739c0cfe3c2` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:53.807465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ff2c49a8b147b0ba137739c0cfe3c2)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:53.809467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:53.856917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ff2c49a8b147b0ba137739c0cfe3c2', 'request_id': 'req-c8e9ce24-cb25-45bc-8477-2288efadddf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.862674 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ff2c49a8b147b0ba137739c0cfe3c2', 'request_id': 'req-c8e9ce24-cb25-45bc-8477-2288efadddf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.871428 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ff2c49a8b147b0ba137739c0cfe3c2', 'request_id': 'req-c8e9ce24-cb25-45bc-8477-2288efadddf1'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.885984 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] The token cache is being invalidate because project 53ff2c49a8b147b0ba137739c0cfe3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:32:53.886457 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.887205 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:53.888778 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1406/2852] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:32:53 2022] DELETE /identity/v3/projects/53ff2c49a8b147b0ba137739c0cfe3c2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:32:53.893246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c677efe-60ce-40c1-8b38-0180add1bf10 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:53.904056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c677efe-60ce-40c1-8b38-0180add1bf10 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:53.967973 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:53.968867 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:53.969158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:53.969427 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] PATH_INFO: `/v3/users/e2dde88982d54217b41b974f8069ed2f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:53.970797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2dde88982d54217b41b974f8069ed2f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:53.972919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:54.019549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2dde88982d54217b41b974f8069ed2f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.020226 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2dde88982d54217b41b974f8069ed2f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.027221 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2dde88982d54217b41b974f8069ed2f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.034650 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2dde88982d54217b41b974f8069ed2f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.035447 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2dde88982d54217b41b974f8069ed2f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.054684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1447/2853] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:32:53 2022] DELETE /identity/v3/users/e2dde88982d54217b41b974f8069ed2f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:54.335124 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:54.336654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:54.350811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9ce24-cb25-45bc-8477-2288efadddf1 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:54.358994 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:54.409422 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:54.410714 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:54.410997 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:54.411271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] PATH_INFO: `/v3/projects/1e492684ad00495e90fca04342d5a0ce` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:54.412517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e492684ad00495e90fca04342d5a0ce)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:54.414416 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:54.459081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e492684ad00495e90fca04342d5a0ce', 'request_id': 'req-786496cf-2c68-453b-b6b5-a74ac0b176d5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.464758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e492684ad00495e90fca04342d5a0ce', 'request_id': 'req-786496cf-2c68-453b-b6b5-a74ac0b176d5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.472177 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e492684ad00495e90fca04342d5a0ce', 'request_id': 'req-786496cf-2c68-453b-b6b5-a74ac0b176d5'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.484663 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] The token cache is being invalidate because project 1e492684ad00495e90fca04342d5a0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:32:54.484946 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.485608 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.487161 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1407/2854] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:32:54 2022] DELETE /identity/v3/projects/1e492684ad00495e90fca04342d5a0ce => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:32:54.491826 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:54.493244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:54.505745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb5e98-b202-4e15-a546-e8436a04f596 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:54.518135 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:54.565924 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:54.567027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:54.567310 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:54.567585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] PATH_INFO: `/v3/users/80ea12dcb9a64b6fb7b3d3d892b87217` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:54.568843 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ea12dcb9a64b6fb7b3d3d892b87217)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:54.571103 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:54.618693 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ea12dcb9a64b6fb7b3d3d892b87217'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.619383 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ea12dcb9a64b6fb7b3d3d892b87217'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.626991 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ea12dcb9a64b6fb7b3d3d892b87217'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.634554 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ea12dcb9a64b6fb7b3d3d892b87217'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.635248 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0a3e4efc-71c9-455e-8593-57708616a3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ea12dcb9a64b6fb7b3d3d892b87217'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:54.653363 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1448/2855] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:32:54 2022] DELETE /identity/v3/users/80ea12dcb9a64b6fb7b3d3d892b87217 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:32:54.928695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:54.930281 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:54.945162 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786496cf-2c68-453b-b6b5-a74ac0b176d5 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.002456 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.003319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.003609 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.003921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] PATH_INFO: `/v3/projects/b1deb2ab2794444ea9ae90a82ae025e3` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.005135 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1deb2ab2794444ea9ae90a82ae025e3)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.007016 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.048817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:55.053601 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1deb2ab2794444ea9ae90a82ae025e3', 'request_id': 'req-c7b5c37f-9d2f-4375-8536-88e317e533ef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:55.060819 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1deb2ab2794444ea9ae90a82ae025e3', 'request_id': 'req-c7b5c37f-9d2f-4375-8536-88e317e533ef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:55.068118 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1deb2ab2794444ea9ae90a82ae025e3', 'request_id': 'req-c7b5c37f-9d2f-4375-8536-88e317e533ef'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:55.079000 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] The token cache is being invalidate because project b1deb2ab2794444ea9ae90a82ae025e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:32:55.079286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:55.079922 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-c7b5c37f-9d2f-4375-8536-88e317e533ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:32:55.081583 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1408/2856] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:32:54 2022] DELETE /identity/v3/projects/b1deb2ab2794444ea9ae90a82ae025e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:55.088177 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900414c0-6afc-47d1-8feb-66732f3883df None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.088466 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900414c0-6afc-47d1-8feb-66732f3883df None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.088738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900414c0-6afc-47d1-8feb-66732f3883df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.107318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-900414c0-6afc-47d1-8feb-66732f3883df None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:55.108549 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-900414c0-6afc-47d1-8feb-66732f3883df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:55.166327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1449/2857] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:55.174749 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b218-6a6c-4692-9979-6c04b841ebc5 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.174982 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b218-6a6c-4692-9979-6c04b841ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.175283 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b218-6a6c-4692-9979-6c04b841ebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.193950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-f7a2b218-6a6c-4692-9979-6c04b841ebc5 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:55.195167 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-f7a2b218-6a6c-4692-9979-6c04b841ebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:55.203039 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1409/2858] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:55.207587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900414c0-6afc-47d1-8feb-66732f3883df None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.217624 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900414c0-6afc-47d1-8feb-66732f3883df None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.224797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.225468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.225782 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.226089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.226827 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:32:55.227136 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.228784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.241423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1450/2859] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:32:55.246308 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2b218-6a6c-4692-9979-6c04b841ebc5 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.255552 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2b218-6a6c-4692-9979-6c04b841ebc5 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.260286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f20c99-f4ee-4fd0-b7cf-c2217cddb266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.260933 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f20c99-f4ee-4fd0-b7cf-c2217cddb266 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.261217 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f20c99-f4ee-4fd0-b7cf-c2217cddb266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.261491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f20c99-f4ee-4fd0-b7cf-c2217cddb266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.262184 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f20c99-f4ee-4fd0-b7cf-c2217cddb266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.264081 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f20c99-f4ee-4fd0-b7cf-c2217cddb266 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.289910 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1410/2860] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:55 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:55.294126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.304069 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d5b85-304d-4b96-afe6-d205abdf28b0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.323914 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:55.362267 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c8d1-732a-4eca-835b-925d121e96ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.362932 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c8d1-732a-4eca-835b-925d121e96ed admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.363239 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c8d1-732a-4eca-835b-925d121e96ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.363516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c8d1-732a-4eca-835b-925d121e96ed admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.364236 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c8d1-732a-4eca-835b-925d121e96ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.366140 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c8d1-732a-4eca-835b-925d121e96ed admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.385516 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1451/2861] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:55 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 11:32:55.389874 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f20c99-f4ee-4fd0-b7cf-c2217cddb266 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.400581 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f20c99-f4ee-4fd0-b7cf-c2217cddb266 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.405491 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af207d7-9e8e-4135-a4b7-d36ca32b2d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.406139 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af207d7-9e8e-4135-a4b7-d36ca32b2d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.406423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af207d7-9e8e-4135-a4b7-d36ca32b2d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.406693 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af207d7-9e8e-4135-a4b7-d36ca32b2d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.407410 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af207d7-9e8e-4135-a4b7-d36ca32b2d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.409035 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af207d7-9e8e-4135-a4b7-d36ca32b2d6c admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.419828 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1411/2862] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:55.423809 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c8d1-732a-4eca-835b-925d121e96ed admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.433645 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c8d1-732a-4eca-835b-925d121e96ed admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.438127 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6a339-20f3-4363-91bc-6fcb5556af3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.438772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6a339-20f3-4363-91bc-6fcb5556af3b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.439054 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6a339-20f3-4363-91bc-6fcb5556af3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.439329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6a339-20f3-4363-91bc-6fcb5556af3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.440052 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6a339-20f3-4363-91bc-6fcb5556af3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.441704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6a339-20f3-4363-91bc-6fcb5556af3b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.451417 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1452/2863] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:55.455683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af207d7-9e8e-4135-a4b7-d36ca32b2d6c admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.466470 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af207d7-9e8e-4135-a4b7-d36ca32b2d6c admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.471046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81912-e880-4023-9a5d-b85594d21172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.471915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81912-e880-4023-9a5d-b85594d21172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.472237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81912-e880-4023-9a5d-b85594d21172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.473138 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81912-e880-4023-9a5d-b85594d21172 admin admin] PATH_INFO: `/v3/projects/e939abdc27fb429db04b686d86553110/users/5c31e0fdf836477ab5b9c0a6c09b8a02/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.487380 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b81912-e880-4023-9a5d-b85594d21172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e939abdc27fb429db04b686d86553110, user_id=5c31e0fdf836477ab5b9c0a6c09b8a02, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.490046 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b81912-e880-4023-9a5d-b85594d21172 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.502594 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1412/2864] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:55 2022] PUT /identity/v3/projects/e939abdc27fb429db04b686d86553110/users/5c31e0fdf836477ab5b9c0a6c09b8a02/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:55.513891 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7431ac-5b5d-4f02-ab74-4b365678d925 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.514387 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7431ac-5b5d-4f02-ab74-4b365678d925 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.514491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7431ac-5b5d-4f02-ab74-4b365678d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.542098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6c7431ac-5b5d-4f02-ab74-4b365678d925 None None] MFA Rules not processed for user `5c31e0fdf836477ab5b9c0a6c09b8a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:55.543337 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6c7431ac-5b5d-4f02-ab74-4b365678d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:55.611014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1453/2865] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:55.615899 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81912-e880-4023-9a5d-b85594d21172 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.688511 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81912-e880-4023-9a5d-b85594d21172 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.693605 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f272-147d-4376-83d9-3239d131c437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.694264 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f272-147d-4376-83d9-3239d131c437 admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.694550 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f272-147d-4376-83d9-3239d131c437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.694838 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9f272-147d-4376-83d9-3239d131c437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.695513 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9f272-147d-4376-83d9-3239d131c437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.697460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9f272-147d-4376-83d9-3239d131c437 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.723562 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1413/2866] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:55 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:55.728056 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7431ac-5b5d-4f02-ab74-4b365678d925 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.740585 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7431ac-5b5d-4f02-ab74-4b365678d925 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.798230 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e36f07-98d3-4310-ad99-f18f2135583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.798892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36f07-98d3-4310-ad99-f18f2135583f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.799181 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36f07-98d3-4310-ad99-f18f2135583f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.799448 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36f07-98d3-4310-ad99-f18f2135583f admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.800145 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e36f07-98d3-4310-ad99-f18f2135583f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.802059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e36f07-98d3-4310-ad99-f18f2135583f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.821751 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1454/2867] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:55 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:55.825904 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f272-147d-4376-83d9-3239d131c437 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.837156 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9f272-147d-4376-83d9-3239d131c437 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.841788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b5bc1-099a-4364-b3b2-fcd0766c8037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.842453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b5bc1-099a-4364-b3b2-fcd0766c8037 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.842742 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b5bc1-099a-4364-b3b2-fcd0766c8037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.843021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b5bc1-099a-4364-b3b2-fcd0766c8037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.843776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b5bc1-099a-4364-b3b2-fcd0766c8037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.845408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b5bc1-099a-4364-b3b2-fcd0766c8037 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.855925 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1414/2868] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:55.859936 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e36f07-98d3-4310-ad99-f18f2135583f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.870173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e36f07-98d3-4310-ad99-f18f2135583f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.874816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d2e99-607a-46d7-be7f-8d35a2639ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.875468 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d2e99-607a-46d7-be7f-8d35a2639ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.875753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d2e99-607a-46d7-be7f-8d35a2639ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.876032 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d2e99-607a-46d7-be7f-8d35a2639ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.876794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d2e99-607a-46d7-be7f-8d35a2639ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.878390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d2e99-607a-46d7-be7f-8d35a2639ad1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.888700 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1455/2869] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:55.892695 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b5bc1-099a-4364-b3b2-fcd0766c8037 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:55.903173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b5bc1-099a-4364-b3b2-fcd0766c8037 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:55.908037 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf8879-edc0-446d-9096-5d85f20356d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:55.908957 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf8879-edc0-446d-9096-5d85f20356d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.909240 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf8879-edc0-446d-9096-5d85f20356d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.909547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf8879-edc0-446d-9096-5d85f20356d0 admin admin] PATH_INFO: `/v3/projects/1dc5cf587b764573a4bcc351f608e417/users/8de57076fa7f4ef6a311dbf92df70199/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.924274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf8879-edc0-446d-9096-5d85f20356d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc5cf587b764573a4bcc351f608e417, user_id=8de57076fa7f4ef6a311dbf92df70199, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:55.926912 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf8879-edc0-446d-9096-5d85f20356d0 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:55.939655 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1415/2870] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:55 2022] PUT /identity/v3/projects/1dc5cf587b764573a4bcc351f608e417/users/8de57076fa7f4ef6a311dbf92df70199/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:32:55.952085 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f567-5704-4d0d-a4fa-7ca347ce50cf None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:55.952408 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f567-5704-4d0d-a4fa-7ca347ce50cf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:55.952698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f567-5704-4d0d-a4fa-7ca347ce50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:55.974101 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:55.982879 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-eba3f567-5704-4d0d-a4fa-7ca347ce50cf None None] MFA Rules not processed for user `8de57076fa7f4ef6a311dbf92df70199`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:55.984327 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-eba3f567-5704-4d0d-a4fa-7ca347ce50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:56.050985 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1456/2871] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:56.056087 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf8879-edc0-446d-9096-5d85f20356d0 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:56.077858 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:56.122496 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf8879-edc0-446d-9096-5d85f20356d0 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:56.127406 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ecc97-4116-4e1e-936b-90d0e92a44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:56.128056 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ecc97-4116-4e1e-936b-90d0e92a44db admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:56.128366 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ecc97-4116-4e1e-936b-90d0e92a44db admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:56.128639 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ecc97-4116-4e1e-936b-90d0e92a44db admin admin] PATH_INFO: `/v3/projects` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:56.130063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ecc97-4116-4e1e-936b-90d0e92a44db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:56.131950 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ecc97-4116-4e1e-936b-90d0e92a44db admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:56.157869 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1416/2872] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:32:56 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:56.162682 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3f567-5704-4d0d-a4fa-7ca347ce50cf None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:56.173280 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3f567-5704-4d0d-a4fa-7ca347ce50cf None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:56.231548 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195a6d-adbb-433b-b861-3fc41d39a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:56.232257 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195a6d-adbb-433b-b861-3fc41d39a78e admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:56.232580 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195a6d-adbb-433b-b861-3fc41d39a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:56.232855 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195a6d-adbb-433b-b861-3fc41d39a78e admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:56.233559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90195a6d-adbb-433b-b861-3fc41d39a78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:56.235470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90195a6d-adbb-433b-b861-3fc41d39a78e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:56.257154 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1457/2873] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:32:56 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:32:56.261399 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ecc97-4116-4e1e-936b-90d0e92a44db admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:56.273415 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ecc97-4116-4e1e-936b-90d0e92a44db admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:56.278034 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a14b0-b9a9-4955-8e1a-6ea49efdcd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:56.278781 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a14b0-b9a9-4955-8e1a-6ea49efdcd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:56.279067 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a14b0-b9a9-4955-8e1a-6ea49efdcd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:56.279341 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a14b0-b9a9-4955-8e1a-6ea49efdcd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:56.280068 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a14b0-b9a9-4955-8e1a-6ea49efdcd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:56.281731 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a14b0-b9a9-4955-8e1a-6ea49efdcd30 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:56.292972 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1417/2874] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:56.297232 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195a6d-adbb-433b-b861-3fc41d39a78e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:56.307139 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195a6d-adbb-433b-b861-3fc41d39a78e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:56.311738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ac962-f016-4a25-9c01-c0c3675df2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:56.312639 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac962-f016-4a25-9c01-c0c3675df2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:56.312928 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac962-f016-4a25-9c01-c0c3675df2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:56.313204 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac962-f016-4a25-9c01-c0c3675df2c1 admin admin] PATH_INFO: `/v3/projects/1d52b2c8f6e1416681c758f8f9ae04e1/users/4fe56379586847a58387dbc89490eeb4/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:56.327719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ac962-f016-4a25-9c01-c0c3675df2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d52b2c8f6e1416681c758f8f9ae04e1, user_id=4fe56379586847a58387dbc89490eeb4, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:56.330400 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ac962-f016-4a25-9c01-c0c3675df2c1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:56.343430 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1458/2875] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:56 2022] PUT /identity/v3/projects/1d52b2c8f6e1416681c758f8f9ae04e1/users/4fe56379586847a58387dbc89490eeb4/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:56.347584 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a14b0-b9a9-4955-8e1a-6ea49efdcd30 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:56.358630 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a14b0-b9a9-4955-8e1a-6ea49efdcd30 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:56.414328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf9d73-55f5-4078-af09-b9f200a812e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:56.415018 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf9d73-55f5-4078-af09-b9f200a812e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:56.415258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf9d73-55f5-4078-af09-b9f200a812e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:56.415531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf9d73-55f5-4078-af09-b9f200a812e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:56.416274 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf9d73-55f5-4078-af09-b9f200a812e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:56.417856 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf9d73-55f5-4078-af09-b9f200a812e5 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:56.428894 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1418/2876] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:32:56.433185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ac962-f016-4a25-9c01-c0c3675df2c1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:56.443832 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ac962-f016-4a25-9c01-c0c3675df2c1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:56.448479 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:56.449355 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:56.449637 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:56.449913 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] PATH_INFO: `/v3/projects/1d52b2c8f6e1416681c758f8f9ae04e1/users/4fe56379586847a58387dbc89490eeb4/roles/1f3292d7ab5149c6bd893360af5355dc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:56.451873 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d52b2c8f6e1416681c758f8f9ae04e1, user_id=4fe56379586847a58387dbc89490eeb4, role_id=1f3292d7ab5149c6bd893360af5355dc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:56.454539 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:56.466006 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1459/2877] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:32:56 2022] PUT /identity/v3/projects/1d52b2c8f6e1416681c758f8f9ae04e1/users/4fe56379586847a58387dbc89490eeb4/roles/1f3292d7ab5149c6bd893360af5355dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:32:56.476963 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cc317-2e4e-4343-aaba-ee7bf2e159b6 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:56.477196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cc317-2e4e-4343-aaba-ee7bf2e159b6 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:56.477507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cc317-2e4e-4343-aaba-ee7bf2e159b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:56.505482 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-fe8cc317-2e4e-4343-aaba-ee7bf2e159b6 None None] MFA Rules not processed for user `4fe56379586847a58387dbc89490eeb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:32:56.506702 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fe8cc317-2e4e-4343-aaba-ee7bf2e159b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:56.576206 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1419/2878] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:32:56.588887 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:56.590652 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:56.651715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cdd5c-7bf6-499a-855e-6aab1845ceb8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:56.655792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0f374-4b81-4473-b965-d5205a757546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:56.656461 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0f374-4b81-4473-b965-d5205a757546 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:56.656743 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0f374-4b81-4473-b965-d5205a757546 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:56.657014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0f374-4b81-4473-b965-d5205a757546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:56.662801 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:56.719711 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0f374-4b81-4473-b965-d5205a757546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:56.721246 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0f374-4b81-4473-b965-d5205a757546 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:56.730496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1460/2879] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:58.208357 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cc317-2e4e-4343-aaba-ee7bf2e159b6 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:58.209767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-fe8cc317-2e4e-4343-aaba-ee7bf2e159b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:32:58.226561 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cc317-2e4e-4343-aaba-ee7bf2e159b6 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:58.230392 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40854b1e-66dc-467e-b684-affdbffdaa04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:58.231047 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854b1e-66dc-467e-b684-affdbffdaa04 service cinder] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:58.231356 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854b1e-66dc-467e-b684-affdbffdaa04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:58.231633 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854b1e-66dc-467e-b684-affdbffdaa04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:58.242332 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:32:58.290260 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40854b1e-66dc-467e-b684-affdbffdaa04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:58.291662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40854b1e-66dc-467e-b684-affdbffdaa04 service cinder] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:58.300723 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1420/2880] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:32:58.833319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0f374-4b81-4473-b965-d5205a757546 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:32:58.842160 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0f374-4b81-4473-b965-d5205a757546 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:32:58.845767 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e6a05-dd8c-4db7-91b0-bacfcbc8bf35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:32:58.846403 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6a05-dd8c-4db7-91b0-bacfcbc8bf35 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:32:58.846689 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6a05-dd8c-4db7-91b0-bacfcbc8bf35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:32:58.846965 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e6a05-dd8c-4db7-91b0-bacfcbc8bf35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:32:58.856424 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e6a05-dd8c-4db7-91b0-bacfcbc8bf35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:32:58.857853 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e6a05-dd8c-4db7-91b0-bacfcbc8bf35 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:32:58.867983 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1461/2881] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:32:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:33:02.711176 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40854b1e-66dc-467e-b684-affdbffdaa04 service cinder] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:02.772028 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40854b1e-66dc-467e-b684-affdbffdaa04 service cinder] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:02.776512 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:02.777381 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:02.777664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:02.777940 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] PATH_INFO: `/v3/users/5c31e0fdf836477ab5b9c0a6c09b8a02` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:02.779126 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c31e0fdf836477ab5b9c0a6c09b8a02)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:02.781063 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:02.827015 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c31e0fdf836477ab5b9c0a6c09b8a02'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:02.827606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c31e0fdf836477ab5b9c0a6c09b8a02'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:02.839644 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c31e0fdf836477ab5b9c0a6c09b8a02'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:02.840439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c31e0fdf836477ab5b9c0a6c09b8a02'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:02.849465 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c31e0fdf836477ab5b9c0a6c09b8a02'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:02.863797 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1421/2882] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:33:02 2022] DELETE /identity/v3/users/5c31e0fdf836477ab5b9c0a6c09b8a02 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:02.868808 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f22cc-faad-4fae-bcff-7fcec96be4ef None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:02.869282 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f22cc-faad-4fae-bcff-7fcec96be4ef None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:02.869420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f22cc-faad-4fae-bcff-7fcec96be4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:02.887489 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f80f22cc-faad-4fae-bcff-7fcec96be4ef None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:33:02.888729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f80f22cc-faad-4fae-bcff-7fcec96be4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:02.947313 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1462/2883] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:33:02.960507 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:02.961938 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:02.997033 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:03.022837 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbe4c5-a446-4a30-ae3c-98b4c31b18d6 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:03.027651 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5057-8ecd-438a-bd5e-ec02fdac20cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:03.028347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5057-8ecd-438a-bd5e-ec02fdac20cb service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:03.028640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5057-8ecd-438a-bd5e-ec02fdac20cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:03.028921 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5057-8ecd-438a-bd5e-ec02fdac20cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:03.038757 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5057-8ecd-438a-bd5e-ec02fdac20cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:03.040270 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5057-8ecd-438a-bd5e-ec02fdac20cb service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:03.049881 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1422/2884] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:33:03.318816 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f22cc-faad-4fae-bcff-7fcec96be4ef None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:03.320308 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f80f22cc-faad-4fae-bcff-7fcec96be4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:03.337841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f22cc-faad-4fae-bcff-7fcec96be4ef None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:03.346456 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:03.347346 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:03.347636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:03.347950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] PATH_INFO: `/v3/projects/e939abdc27fb429db04b686d86553110` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:03.349842 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e939abdc27fb429db04b686d86553110)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:03.351792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:03.398428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e939abdc27fb429db04b686d86553110', 'request_id': 'req-2b262d6c-7590-4908-833b-0de38f977cee'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.404382 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e939abdc27fb429db04b686d86553110', 'request_id': 'req-2b262d6c-7590-4908-833b-0de38f977cee'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.412397 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e939abdc27fb429db04b686d86553110', 'request_id': 'req-2b262d6c-7590-4908-833b-0de38f977cee'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.422804 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] The token cache is being invalidate because project e939abdc27fb429db04b686d86553110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:33:03.423098 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.423719 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.425283 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1463/2885] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:33:03 2022] DELETE /identity/v3/projects/e939abdc27fb429db04b686d86553110 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:03.429857 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5057-8ecd-438a-bd5e-ec02fdac20cb service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:03.439705 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5057-8ecd-438a-bd5e-ec02fdac20cb service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:03.495316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:03.496226 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:03.496508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:03.496805 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] PATH_INFO: `/v3/users/8de57076fa7f4ef6a311dbf92df70199` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:03.497973 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de57076fa7f4ef6a311dbf92df70199)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:03.499870 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:03.545830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de57076fa7f4ef6a311dbf92df70199'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.546480 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de57076fa7f4ef6a311dbf92df70199'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.558558 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de57076fa7f4ef6a311dbf92df70199'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.559411 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de57076fa7f4ef6a311dbf92df70199'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.567024 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de57076fa7f4ef6a311dbf92df70199'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.580286 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1423/2886] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:33:03 2022] DELETE /identity/v3/users/8de57076fa7f4ef6a311dbf92df70199 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:03.859712 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:03.861199 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:03.875817 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b262d6c-7590-4908-833b-0de38f977cee admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:03.889792 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:03.934738 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:03.935515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:03.935795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:03.936065 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] PATH_INFO: `/v3/projects/1dc5cf587b764573a4bcc351f608e417` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:03.937264 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc5cf587b764573a4bcc351f608e417)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:03.939170 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:03.984432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc5cf587b764573a4bcc351f608e417', 'request_id': 'req-01e33ec5-59ce-4d94-9c11-251e003f46d8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.990316 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc5cf587b764573a4bcc351f608e417', 'request_id': 'req-01e33ec5-59ce-4d94-9c11-251e003f46d8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:03.997784 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc5cf587b764573a4bcc351f608e417', 'request_id': 'req-01e33ec5-59ce-4d94-9c11-251e003f46d8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.011423 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] The token cache is being invalidate because project 1dc5cf587b764573a4bcc351f608e417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:33:04.011715 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.012385 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.014033 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1464/2887] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:33:03 2022] DELETE /identity/v3/projects/1dc5cf587b764573a4bcc351f608e417 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:04.018021 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:04.019468 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:04.032659 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4818283-bd84-4e7c-93cf-d3e77eec8d8e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:04.079104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:04.090297 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:04.091180 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:04.091460 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:04.091735 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] PATH_INFO: `/v3/users/4fe56379586847a58387dbc89490eeb4` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:04.092975 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe56379586847a58387dbc89490eeb4)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:04.095085 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:04.140895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe56379586847a58387dbc89490eeb4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.141542 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe56379586847a58387dbc89490eeb4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.154169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe56379586847a58387dbc89490eeb4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.154817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe56379586847a58387dbc89490eeb4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.163208 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-0bde9230-7c32-4965-9697-f4d162024aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe56379586847a58387dbc89490eeb4'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.178136 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1424/2888] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:33:04 2022] DELETE /identity/v3/users/4fe56379586847a58387dbc89490eeb4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:04.697759 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:04.699319 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:04.711841 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e33ec5-59ce-4d94-9c11-251e003f46d8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:04.769270 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:04.770141 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:04.770426 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:04.770705 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] PATH_INFO: `/v3/projects/1d52b2c8f6e1416681c758f8f9ae04e1` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:04.771902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d52b2c8f6e1416681c758f8f9ae04e1)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:04.773846 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:04.820498 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d52b2c8f6e1416681c758f8f9ae04e1', 'request_id': 'req-daa8b88d-ad90-4057-a682-288feec564f4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.821440 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:04.827872 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d52b2c8f6e1416681c758f8f9ae04e1', 'request_id': 'req-daa8b88d-ad90-4057-a682-288feec564f4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.835256 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d52b2c8f6e1416681c758f8f9ae04e1', 'request_id': 'req-daa8b88d-ad90-4057-a682-288feec564f4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.846041 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] The token cache is being invalidate because project 1d52b2c8f6e1416681c758f8f9ae04e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:33:04.846329 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.847014 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-daa8b88d-ad90-4057-a682-288feec564f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:04.848667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1465/2889] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:33:04 2022] DELETE /identity/v3/projects/1d52b2c8f6e1416681c758f8f9ae04e1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:04.854104 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808847-c712-4e0a-9a2a-054f395444c1 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:04.854397 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808847-c712-4e0a-9a2a-054f395444c1 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:04.854678 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3808847-c712-4e0a-9a2a-054f395444c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:04.873020 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-e3808847-c712-4e0a-9a2a-054f395444c1 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:33:04.874237 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-e3808847-c712-4e0a-9a2a-054f395444c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:04.932268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1425/2890] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:33:04.939996 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583de8f-ced3-4e49-944a-a7fc7a081444 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:04.940511 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583de8f-ced3-4e49-944a-a7fc7a081444 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:04.940623 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583de8f-ced3-4e49-944a-a7fc7a081444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:04.959057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8583de8f-ced3-4e49-944a-a7fc7a081444 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:33:04.960287 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8583de8f-ced3-4e49-944a-a7fc7a081444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:04.968393 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1466/2891] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:33:04.972638 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3808847-c712-4e0a-9a2a-054f395444c1 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:04.982835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3808847-c712-4e0a-9a2a-054f395444c1 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:04.987271 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:04.987918 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:04.988230 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:04.988503 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:04.989221 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:33:04.989522 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:04.991171 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:05.002485 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1426/2892] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:33:05.006858 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583de8f-ced3-4e49-944a-a7fc7a081444 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:05.016124 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583de8f-ced3-4e49-944a-a7fc7a081444 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:05.023434 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4378-7aeb-457f-9d57-d1b8dffe339d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:05.024343 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4378-7aeb-457f-9d57-d1b8dffe339d admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:05.024627 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4378-7aeb-457f-9d57-d1b8dffe339d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:05.024906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4378-7aeb-457f-9d57-d1b8dffe339d admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:05.025611 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4378-7aeb-457f-9d57-d1b8dffe339d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:05.027514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4378-7aeb-457f-9d57-d1b8dffe339d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:05.056592 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1467/2893] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:33:05 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:33:05.057711 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:05.067965 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90acd5-a2b4-441d-8150-8e7220227a1f admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:05.124653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9d72a-d26d-4be8-b4f2-9d670a3b63ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:05.125328 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d72a-d26d-4be8-b4f2-9d670a3b63ec admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:05.125614 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d72a-d26d-4be8-b4f2-9d670a3b63ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:05.125893 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d72a-d26d-4be8-b4f2-9d670a3b63ec admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:05.126590 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9d72a-d26d-4be8-b4f2-9d670a3b63ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:05.128543 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9d72a-d26d-4be8-b4f2-9d670a3b63ec admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:05.135108 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:05.150683 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1427/2894] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:33:05 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:33:05.156185 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4378-7aeb-457f-9d57-d1b8dffe339d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:05.167188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4378-7aeb-457f-9d57-d1b8dffe339d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:05.171825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa01e7-e603-490b-a703-1215ac06410a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:05.172587 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa01e7-e603-490b-a703-1215ac06410a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:05.172799 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa01e7-e603-490b-a703-1215ac06410a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:05.173075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa01e7-e603-490b-a703-1215ac06410a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:05.173795 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa01e7-e603-490b-a703-1215ac06410a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:05.175395 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa01e7-e603-490b-a703-1215ac06410a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:05.185756 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1468/2895] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:33:05.189739 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9d72a-d26d-4be8-b4f2-9d670a3b63ec admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:05.199789 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9d72a-d26d-4be8-b4f2-9d670a3b63ec admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:05.204298 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45fb07-ab4e-4f13-8d52-59a3980449a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:05.204947 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45fb07-ab4e-4f13-8d52-59a3980449a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:05.205219 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45fb07-ab4e-4f13-8d52-59a3980449a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:05.205497 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45fb07-ab4e-4f13-8d52-59a3980449a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:05.206212 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45fb07-ab4e-4f13-8d52-59a3980449a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:05.207793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45fb07-ab4e-4f13-8d52-59a3980449a6 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:05.219801 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1428/2896] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:33:05.224989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa01e7-e603-490b-a703-1215ac06410a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:05.235011 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa01e7-e603-490b-a703-1215ac06410a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:05.239618 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:05.240530 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:05.240815 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:05.241089 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] PATH_INFO: `/v3/projects/936ca0f88f654afebd26f9bd9a60d607/users/a25ea32b8e8445f8a98cdf4869d7233c/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:05.256533 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ca0f88f654afebd26f9bd9a60d607, user_id=a25ea32b8e8445f8a98cdf4869d7233c, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:05.259217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:05.272431 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1469/2897] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:33:05 2022] PUT /identity/v3/projects/936ca0f88f654afebd26f9bd9a60d607/users/a25ea32b8e8445f8a98cdf4869d7233c/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:05.282621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d89d-3503-4dd8-b0b7-e5894c6398c3 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:05.282930 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d89d-3503-4dd8-b0b7-e5894c6398c3 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:05.283209 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11d89d-3503-4dd8-b0b7-e5894c6398c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:05.311486 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-5d11d89d-3503-4dd8-b0b7-e5894c6398c3 None None] MFA Rules not processed for user `a25ea32b8e8445f8a98cdf4869d7233c`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:33:05.312864 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-5d11d89d-3503-4dd8-b0b7-e5894c6398c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:05.381597 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1429/2898] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:33:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:33:05.393496 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:05.395196 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:05.481825 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7eba-f63a-4925-a9e3-bc035364558b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:05.485501 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce073-242e-404d-ab00-b12bdb4d5d08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c97bd14230147a5bd004c71f5387098', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:05.486228 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce073-242e-404d-ab00-b12bdb4d5d08 service glance] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:05.486562 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce073-242e-404d-ab00-b12bdb4d5d08 service glance] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:05.486865 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce073-242e-404d-ab00-b12bdb4d5d08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:05.496344 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce073-242e-404d-ab00-b12bdb4d5d08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:05.497915 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce073-242e-404d-ab00-b12bdb4d5d08 service glance] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:05.508582 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1470/2899] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:33:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:33:15.377818 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:15.503334 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=68,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:32.173197 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11d89d-3503-4dd8-b0b7-e5894c6398c3 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:32.243387 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11d89d-3503-4dd8-b0b7-e5894c6398c3 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:32.247878 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:32.248787 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:32.249106 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:32.249390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] PATH_INFO: `/v3/users/a25ea32b8e8445f8a98cdf4869d7233c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:32.250582 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25ea32b8e8445f8a98cdf4869d7233c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:32.252546 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:32.299508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25ea32b8e8445f8a98cdf4869d7233c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.300573 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25ea32b8e8445f8a98cdf4869d7233c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.314350 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25ea32b8e8445f8a98cdf4869d7233c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.315032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25ea32b8e8445f8a98cdf4869d7233c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.322309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25ea32b8e8445f8a98cdf4869d7233c'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.334795 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1430/2900] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:33:32 2022] DELETE /identity/v3/users/a25ea32b8e8445f8a98cdf4869d7233c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:32.339559 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc8049-042c-4b4b-b15f-d0a6bb049779 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:32.340051 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc8049-042c-4b4b-b15f-d0a6bb049779 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:32.340188 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc8049-042c-4b4b-b15f-d0a6bb049779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:32.357745 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2ebc8049-042c-4b4b-b15f-d0a6bb049779 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:33:32.358962 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2ebc8049-042c-4b4b-b15f-d0a6bb049779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:32.416277 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1471/2901] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:33:32.426017 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:32.428091 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:32.502699 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cab8f-24d1-498a-b2dc-f4904ed9543e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:32.506378 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af23b52-9178-424f-b61b-94bb224da089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:32.507030 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af23b52-9178-424f-b61b-94bb224da089 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:32.507324 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af23b52-9178-424f-b61b-94bb224da089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:32.507598 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af23b52-9178-424f-b61b-94bb224da089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:32.517254 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af23b52-9178-424f-b61b-94bb224da089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:32.518740 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af23b52-9178-424f-b61b-94bb224da089 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:32.528760 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1431/2902] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:33:32.803111 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc8049-042c-4b4b-b15f-d0a6bb049779 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:32.804788 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2ebc8049-042c-4b4b-b15f-d0a6bb049779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:32.818704 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc8049-042c-4b4b-b15f-d0a6bb049779 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:32.823698 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:32.824609 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:32.825537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:32.825980 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] PATH_INFO: `/v3/projects/936ca0f88f654afebd26f9bd9a60d607` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:32.827209 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] RBAC: Authorizing `identity:delete_project(project_id=936ca0f88f654afebd26f9bd9a60d607)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:32.829153 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:32.875520 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936ca0f88f654afebd26f9bd9a60d607', 'request_id': 'req-a62f2f08-377d-4b97-bc7d-d651ec85680d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.881531 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936ca0f88f654afebd26f9bd9a60d607', 'request_id': 'req-a62f2f08-377d-4b97-bc7d-d651ec85680d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.888967 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936ca0f88f654afebd26f9bd9a60d607', 'request_id': 'req-a62f2f08-377d-4b97-bc7d-d651ec85680d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.899797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] The token cache is being invalidate because project 936ca0f88f654afebd26f9bd9a60d607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:33:32.900081 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.900726 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a62f2f08-377d-4b97-bc7d-d651ec85680d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:33:32.902238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1472/2903] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:33:32 2022] DELETE /identity/v3/projects/936ca0f88f654afebd26f9bd9a60d607 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:33:32.907042 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76929-277e-4401-aa6b-ec6cca33fb58 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:32.907330 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76929-277e-4401-aa6b-ec6cca33fb58 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:32.907606 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76929-277e-4401-aa6b-ec6cca33fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:32.924532 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-c6f76929-277e-4401-aa6b-ec6cca33fb58 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:33:32.925664 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-c6f76929-277e-4401-aa6b-ec6cca33fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:32.942788 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:32.985516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1432/2904] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:33:32.993881 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3503-7d50-4b66-8004-a93a43c7b735 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:32.994163 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3503-7d50-4b66-8004-a93a43c7b735 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:32.994439 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3503-7d50-4b66-8004-a93a43c7b735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.013684 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-869a3503-7d50-4b66-8004-a93a43c7b735 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:33:33.014892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-869a3503-7d50-4b66-8004-a93a43c7b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:33.022729 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1473/2905] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:33:33.027149 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f76929-277e-4401-aa6b-ec6cca33fb58 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:33.037557 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f76929-277e-4401-aa6b-ec6cca33fb58 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:33.042155 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:33.042875 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:33.043186 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:33.043462 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.044361 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80333) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 11:33:33.044666 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:33.046259 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:33.058686 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1433/2906] 10.222.0.17 () {58 vars in 1152 bytes} [Thu Jul 14 11:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 11:33:33.062921 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a3503-7d50-4b66-8004-a93a43c7b735 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:33.072158 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a3503-7d50-4b66-8004-a93a43c7b735 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:33.076862 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e55d8-daa3-4b03-8e5d-0435c185f610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:33.077514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e55d8-daa3-4b03-8e5d-0435c185f610 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:33.077797 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e55d8-daa3-4b03-8e5d-0435c185f610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:33.078071 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e55d8-daa3-4b03-8e5d-0435c185f610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.078802 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e55d8-daa3-4b03-8e5d-0435c185f610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:33.080737 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e55d8-daa3-4b03-8e5d-0435c185f610 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:33.106390 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1474/2907] 10.222.0.17 () {60 vars in 1152 bytes} [Thu Jul 14 11:33:33 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:33:33.110447 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:33.120926 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87dfb5-1e73-4513-afef-af971f767c29 admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:33.176776 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e70e9-18f2-402f-b2fc-867910439fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:33.177398 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e70e9-18f2-402f-b2fc-867910439fad admin admin] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:33.178314 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e70e9-18f2-402f-b2fc-867910439fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:33.178596 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e70e9-18f2-402f-b2fc-867910439fad admin admin] PATH_INFO: `/v3/users` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.179284 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e70e9-18f2-402f-b2fc-867910439fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:33.181290 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e70e9-18f2-402f-b2fc-867910439fad admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:33.200615 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1434/2908] 10.222.0.17 () {60 vars in 1143 bytes} [Thu Jul 14 11:33:33 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 11:33:33.204708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e55d8-daa3-4b03-8e5d-0435c185f610 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:33.215290 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e55d8-daa3-4b03-8e5d-0435c185f610 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:33.219909 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22e441-07cb-41e0-9dec-8a6a07f43c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:33.220599 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22e441-07cb-41e0-9dec-8a6a07f43c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:33.220883 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22e441-07cb-41e0-9dec-8a6a07f43c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:33.221152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22e441-07cb-41e0-9dec-8a6a07f43c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.221875 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22e441-07cb-41e0-9dec-8a6a07f43c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:33.223473 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22e441-07cb-41e0-9dec-8a6a07f43c54 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:33.235067 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1475/2909] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:33:33.239029 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e70e9-18f2-402f-b2fc-867910439fad admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:33.249588 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e70e9-18f2-402f-b2fc-867910439fad admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:33.254116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a8edc-994d-4488-9fd7-d07cd26c0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:33.254767 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8edc-994d-4488-9fd7-d07cd26c0711 admin admin] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:33.255044 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8edc-994d-4488-9fd7-d07cd26c0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:33.255317 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8edc-994d-4488-9fd7-d07cd26c0711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.256065 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a8edc-994d-4488-9fd7-d07cd26c0711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:33.257688 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a8edc-994d-4488-9fd7-d07cd26c0711 admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:33.267876 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1435/2910] 10.222.0.17 () {58 vars in 1121 bytes} [Thu Jul 14 11:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 11:33:33.271949 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22e441-07cb-41e0-9dec-8a6a07f43c54 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:33.282001 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22e441-07cb-41e0-9dec-8a6a07f43c54 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:33.286569 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:33.287977 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:33.288573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:33.288861 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] PATH_INFO: `/v3/projects/2e09d98bec2643f38c204481ea485b1c/users/51de797845ac4a7e8a56d6c6e9a55287/roles/3c87a6985254480b960b2a9ddfc5d7cc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.304126 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e09d98bec2643f38c204481ea485b1c, user_id=51de797845ac4a7e8a56d6c6e9a55287, role_id=3c87a6985254480b960b2a9ddfc5d7cc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:33.307005 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:33.319863 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1476/2911] 10.222.0.17 () {60 vars in 1482 bytes} [Thu Jul 14 11:33:33 2022] PUT /identity/v3/projects/2e09d98bec2643f38c204481ea485b1c/users/51de797845ac4a7e8a56d6c6e9a55287/roles/3c87a6985254480b960b2a9ddfc5d7cc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:33:33.330843 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10fb9-8476-4d81-bb6c-c5b121c24c0d None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:33.331140 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10fb9-8476-4d81-bb6c-c5b121c24c0d None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:33.331423 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c10fb9-8476-4d81-bb6c-c5b121c24c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.364444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-15c10fb9-8476-4d81-bb6c-c5b121c24c0d None None] MFA Rules not processed for user `51de797845ac4a7e8a56d6c6e9a55287`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:33:33.366251 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-15c10fb9-8476-4d81-bb6c-c5b121c24c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:33.430133 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1436/2912] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:33:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:33:33.441244 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:33.443057 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:33.465470 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:33.503864 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447cac-6eb2-4292-97b4-3a2525274144 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:33.507537 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636922f-893f-4dac-b7ab-446b9ce2ad81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46f7ca6d48c4124a9af1dc3a74c37a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:33.508224 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636922f-893f-4dac-b7ab-446b9ce2ad81 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:33.508509 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636922f-893f-4dac-b7ab-446b9ce2ad81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:33.508783 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636922f-893f-4dac-b7ab-446b9ce2ad81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:33.517672 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636922f-893f-4dac-b7ab-446b9ce2ad81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:33.519117 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636922f-893f-4dac-b7ab-446b9ce2ad81 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:33.529142 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1477/2913] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:33:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:33:43.426607 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:43.525269 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=17 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:33:49.186223 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10fb9-8476-4d81-bb6c-c5b121c24c0d None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:33:49.187744 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-15c10fb9-8476-4d81-bb6c-c5b121c24c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:49.248012 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c10fb9-8476-4d81-bb6c-c5b121c24c0d None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:33:49.251640 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80961b4b-d588-4e6a-b82c-cd2a5b7a805b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:33:49.252325 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80961b4b-d588-4e6a-b82c-cd2a5b7a805b service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:33:49.252610 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80961b4b-d588-4e6a-b82c-cd2a5b7a805b service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:33:49.252888 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80961b4b-d588-4e6a-b82c-cd2a5b7a805b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:33:49.254672 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-80961b4b-d588-4e6a-b82c-cd2a5b7a805b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:33:49.267169 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80961b4b-d588-4e6a-b82c-cd2a5b7a805b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:33:49.268772 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80961b4b-d588-4e6a-b82c-cd2a5b7a805b service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:33:49.277265 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1437/2914] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:33:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:33:59.273830 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=26 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:08.327830 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636922f-893f-4dac-b7ab-446b9ce2ad81 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:08.394428 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636922f-893f-4dac-b7ab-446b9ce2ad81 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:08.399045 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:08.399907 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:08.400216 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:08.400491 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] PATH_INFO: `/v3/users/51de797845ac4a7e8a56d6c6e9a55287` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:08.401666 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=51de797845ac4a7e8a56d6c6e9a55287)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:08.403567 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:08.447903 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51de797845ac4a7e8a56d6c6e9a55287'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:08.448626 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51de797845ac4a7e8a56d6c6e9a55287'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:08.455708 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51de797845ac4a7e8a56d6c6e9a55287'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:08.464034 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51de797845ac4a7e8a56d6c6e9a55287'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:08.464791 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51de797845ac4a7e8a56d6c6e9a55287'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:08.483198 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1478/2915] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:34:08 2022] DELETE /identity/v3/users/51de797845ac4a7e8a56d6c6e9a55287 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:34:08.487704 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48464-b032-4614-8a78-49e005d4fc12 None None] REQUEST_METHOD: `POST` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:08.488231 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48464-b032-4614-8a78-49e005d4fc12 None None] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:08.488358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa48464-b032-4614-8a78-49e005d4fc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:08.506896 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.auth.core [None req-4fa48464-b032-4614-8a78-49e005d4fc12 None None] MFA Rules not processed for user `7c31e5107fca4386ab7dffdeb4815b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80333) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 11:34:08.508775 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4fa48464-b032-4614-8a78-49e005d4fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:08.569408 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1438/2916] 10.222.0.17 () {58 vars in 957 bytes} [Thu Jul 14 11:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 11:34:08.579905 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:08.580989 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:08.636919 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016dbaf-b68b-4d21-8b33-99e0aeff32cb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:08.640678 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ea764-c51b-4a88-9711-271cd2622ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:08.641351 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ea764-c51b-4a88-9711-271cd2622ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:08.641632 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ea764-c51b-4a88-9711-271cd2622ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:08.641902 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ea764-c51b-4a88-9711-271cd2622ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:08.650918 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ea764-c51b-4a88-9711-271cd2622ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:08.652377 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ea764-c51b-4a88-9711-271cd2622ea4 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:08.661564 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1479/2917] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:34:09.186309 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa48464-b032-4614-8a78-49e005d4fc12 None None] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:09.187977 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4fa48464-b032-4614-8a78-49e005d4fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:09.205153 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa48464-b032-4614-8a78-49e005d4fc12 None None] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:09.215084 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:09.216338 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:09.216665 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:09.216981 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] PATH_INFO: `/v3/projects/2e09d98bec2643f38c204481ea485b1c` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:09.218339 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e09d98bec2643f38c204481ea485b1c)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:09.220536 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:09.274116 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e09d98bec2643f38c204481ea485b1c', 'request_id': 'req-4be75286-2cfa-4df1-9df4-99ee6c6e433e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:09.279621 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e09d98bec2643f38c204481ea485b1c', 'request_id': 'req-4be75286-2cfa-4df1-9df4-99ee6c6e433e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:09.290516 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e09d98bec2643f38c204481ea485b1c', 'request_id': 'req-4be75286-2cfa-4df1-9df4-99ee6c6e433e'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:09.302123 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] The token cache is being invalidate because project 2e09d98bec2643f38c204481ea485b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:34:09.302409 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:09.303058 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:34:09.305158 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1439/2918] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:34:09 2022] DELETE /identity/v3/projects/2e09d98bec2643f38c204481ea485b1c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:34:13.590635 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ea764-c51b-4a88-9711-271cd2622ea4 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:13.599369 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ea764-c51b-4a88-9711-271cd2622ea4 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:13.616840 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:13.649059 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:13.649730 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:13.650016 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:13.650294 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:13.652070 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:13.723779 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:13.725173 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:13.736152 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1480/2919] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:34:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:34:14.913450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:14.914865 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:14.927547 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be75286-2cfa-4df1-9df4-99ee6c6e433e admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:14.931720 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:14.932390 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:14.932673 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:14.932949 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:14.934684 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:14.949268 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:14.950706 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:14.962508 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1440/2920] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:34:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:34:23.731574 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=44 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:24.956980 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:26.814432 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:26.815950 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:26.827279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1058a61-8576-49f8-b382-9155d3f9bfef service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:26.830908 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:26.831550 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:26.831834 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:26.832131 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:26.833904 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:26.847314 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:26.848727 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:26.857265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1481/2921] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:34:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 11:34:27.966164 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:27.974628 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c3263-faaa-4e65-adcb-bb6b1dd235a9 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:27.978258 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:27.978891 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:27.979173 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:27.979444 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:27.981862 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:27.991642 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:27.993093 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:28.001968 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1441/2922] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:34:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:34:28.076899 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:28.085831 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04d5eb-9f33-4703-8494-2e206c57a46a service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:28.090616 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:28.091378 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:28.091659 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:28.091937 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:28.093772 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:28.107796 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:28.109279 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:28.120518 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1482/2923] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:34:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:34:28.180682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:34:28.182007 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:28.251379 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe99ff-afa4-47cc-87ea-1cabac6ec270 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:34:28.256446 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:34:28.257094 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:34:28.257375 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:34:28.257654 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:34:28.259450 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:34:28.271917 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:34:28.273531 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:34:28.284096 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1442/2924] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:34:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:34:38.115436 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=12 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:34:38.279707 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=38 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:10.222794 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:10.259882 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a30eb-a1da-41e6-9252-78332d93654d service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:10.264037 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:10.264716 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:10.264993 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:10.265265 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:10.267049 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:10.347407 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:10.348874 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:10.357667 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1483/2925] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:36:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:36:11.212914 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:11.214717 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:11.321362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45425-c093-4154-ac1a-2fedea762efe service placement] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:11.327461 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:11.329551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:11.329835 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:11.330107 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:11.332551 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:11.348793 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:11.350727 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:11.382895 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1443/2926] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:36:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:36:13.548822 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:13.550890 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:13.569453 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac7693-6751-4454-9ed4-03165f3d3409 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:13.576699 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00b59b80b61a4dec8f4df2bc8a45d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:13.577353 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:13.577636 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:13.577906 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:13.579718 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:13.593338 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:13.594951 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:13.606312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1484/2927] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:36:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:36:16.054783 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:16.064358 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517c40e-069a-4443-9ea9-f7bf51ba0b92 service nova] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:16.067849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a367d904a4a44e91862da4aea28a123b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:16.068517 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] REQUEST_METHOD: `GET` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:16.068882 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:16.069077 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:16.070849 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:16.155758 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:16.157347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:16.177073 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1444/2928] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:36:22.544420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:22.546012 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:22.562878 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e3c43-556a-4908-acd9-cc0ac039bbcf service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:22.568994 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:22.569889 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:22.570172 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:22.570515 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] PATH_INFO: `/v3/users/657f14c04cc64ad38c4fc1ffbb6bff86` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:22.571959 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=657f14c04cc64ad38c4fc1ffbb6bff86)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:22.573992 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:22.630076 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657f14c04cc64ad38c4fc1ffbb6bff86'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.630753 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657f14c04cc64ad38c4fc1ffbb6bff86'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.641304 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657f14c04cc64ad38c4fc1ffbb6bff86'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.650892 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657f14c04cc64ad38c4fc1ffbb6bff86'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.651514 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657f14c04cc64ad38c4fc1ffbb6bff86'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.674075 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1485/2929] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:36:22 2022] DELETE /identity/v3/users/657f14c04cc64ad38c4fc1ffbb6bff86 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:36:22.846915 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:22.857312 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373861-c098-4241-a3dd-d163351ec276 service neutron] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:22.891362 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=100 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:22.914376 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:22.915267 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:22.915546 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:22.915817 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] PATH_INFO: `/v3/projects/a61726a3da4a46a88bd19e48cb92fcd0` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:22.917070 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a61726a3da4a46a88bd19e48cb92fcd0)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:22.918958 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:22.966316 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a61726a3da4a46a88bd19e48cb92fcd0', 'request_id': 'req-ea0827f7-889b-4121-a93c-8f40af1b314a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.971697 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a61726a3da4a46a88bd19e48cb92fcd0', 'request_id': 'req-ea0827f7-889b-4121-a93c-8f40af1b314a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.979010 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a61726a3da4a46a88bd19e48cb92fcd0', 'request_id': 'req-ea0827f7-889b-4121-a93c-8f40af1b314a'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.992804 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] The token cache is being invalidate because project a61726a3da4a46a88bd19e48cb92fcd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:36:22.993213 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.994165 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:22.995687 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1445/2930] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:36:22 2022] DELETE /identity/v3/projects/a61726a3da4a46a88bd19e48cb92fcd0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:36:22.999763 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:23.001217 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:23.014695 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c771f4-c9fb-4b6a-957f-ea4d4af945b8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:23.019318 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:23.072312 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:23.073218 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:23.073499 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:23.073777 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] PATH_INFO: `/v3/users/3fb35f0f1a7b4fbb85939cc1270b89f9` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:23.074971 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb35f0f1a7b4fbb85939cc1270b89f9)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:23.076931 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:23.122542 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb35f0f1a7b4fbb85939cc1270b89f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.123182 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb35f0f1a7b4fbb85939cc1270b89f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.129895 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb35f0f1a7b4fbb85939cc1270b89f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.136970 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb35f0f1a7b4fbb85939cc1270b89f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.137576 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb35f0f1a7b4fbb85939cc1270b89f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.157420 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1486/2931] 10.222.0.17 () {58 vars in 1223 bytes} [Thu Jul 14 11:36:22 2022] DELETE /identity/v3/users/3fb35f0f1a7b4fbb85939cc1270b89f9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 11:36:23.332319 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] Authenticating user token {{(pid=80333) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:23.333811 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.fernet_utils [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80333) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:23.347114 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0827f7-889b-4121-a93c-8f40af1b314a admin admin] Validating token access rules against request {{(pid=80333) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:23.412003 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c31e5107fca4386ab7dffdeb4815b90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bd9aa1d8c77470b8cfa8dc04c19be52', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80333) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:23.412913 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:23.413196 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:23.413467 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] PATH_INFO: `/v3/projects/58770f6c181e4706bbe30adfef830c42` {{(pid=80333) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:23.415662 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=58770f6c181e4706bbe30adfef830c42)` {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:23.420289 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] RBAC: Authorization granted {{(pid=80333) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:23.468653 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58770f6c181e4706bbe30adfef830c42', 'request_id': 'req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.474032 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58770f6c181e4706bbe30adfef830c42', 'request_id': 'req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.481572 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58770f6c181e4706bbe30adfef830c42', 'request_id': 'req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca'} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.488682 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:23.493995 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] The token cache is being invalidate because project 58770f6c181e4706bbe30adfef830c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80333) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 11:36:23.494439 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.495453 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG keystone.notifications [None req-2b7cdb9c-401a-44a0-82db-7176cca2f1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80333) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 11:36:23.497347 dv-cinder-848938-2-smb devstack@keystone.service[80333]: [pid: 80333|app: 0|req: 1446/2932] 10.222.0.17 () {58 vars in 1232 bytes} [Thu Jul 14 11:36:23 2022] DELETE /identity/v3/projects/58770f6c181e4706bbe30adfef830c42 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 11:36:33.152038 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:33.498556 dv-cinder-848938-2-smb devstack@keystone.service[80333]: DEBUG dbcounter [-] [80333] Writing DB stats keystone:SELECT=1 {{(pid=80333) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 11:36:50.478590 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 11:36:50.480043 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:50.570755 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cf2f3-dc56-423b-8935-9059ca56b6cb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 11:36:50.629008 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb607cf-de0e-473f-94cf-d0e154b0561f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee535097c03140178d287921bc1752b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71894a85f39844e8b4ed12f827930b19', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 11:36:50.629671 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb607cf-de0e-473f-94cf-d0e154b0561f service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 11:36:50.629957 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb607cf-de0e-473f-94cf-d0e154b0561f service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 11:36:50.630234 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb607cf-de0e-473f-94cf-d0e154b0561f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 11:36:50.632146 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-beb607cf-de0e-473f-94cf-d0e154b0561f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 11:36:50.644027 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb607cf-de0e-473f-94cf-d0e154b0561f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 11:36:50.645573 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb607cf-de0e-473f-94cf-d0e154b0561f service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 11:36:50.655331 dv-cinder-848938-2-smb devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1487/2933] 10.222.0.17 () {60 vars in 1365 bytes} [Thu Jul 14 11:36:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 11:37:00.651238 dv-cinder-848938-2-smb devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=67 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}